I can say for sure that some of our datastore-heavy cron jobs were taking > 200ms, but are around 70ms now.
It's a shame that the stats for > 12hrs ago seem to have been wiped. I bet we'd be seeing a marked improvement on our ms/request stat.
I tried using the task queue, but it kept timing out on me, even when I broke my tasks into smaller ones (couldn't figure out a threshold as the behavior of the datastore was totally unpredictable).
A URL invoked by cron is subject to the same limits
and quotas as a normal HTTP request, including
the request time limit.
You can also explore the new Mapper API at http://blog.notdot.net/2010/05/Exploring-the-new-mapper-API
AppEngine requires careful thought of application design at this point. Everything is an HTTP request and subject to the same restrictions.
I've heard rumours that they'll be launching longer-lived tasks at some point in the future, but I have no idea when that will happen.
Even our cron job to compute the top users on our site (a simple query + ordering) uses one second of CPU time between the application and the datastore. It's just something you get used to in AppEngine.
Just click the left-facing arrow next to the date. Here are the stats for 11/5: http://code.google.com/status/appengine/detail/datastore/201...
and here are the stats for 11/4: http://code.google.com/status/appengine/detail/datastore/201...
One interesting aside: our nightly datastore backup (using the remote API) no longer causes 500 errors! Hooray!
EDIT: I neglected to see the other datastore figures.
It definitely makes me reconsider using App Engine for new projects.
Disclaimer: I have no connection to Appbrain aside from meeting the developers once.
Kudos to the team, and I, too, hope that the latency will remain this low forever and ever…
The maintenance work has been completed. The datastore was in a read-only period between 12:02-12:45 for a total of 43 minutes. Some users reported two periods of 500 errors unrelated to datastore writes, but these issues should no longer be occurring.
On Nov 6, 12:01 pm, App Engine Downtime Notify <i...@google.com>
(By the way, the above site was my gift for my son on his fourth birthday)
AWS is very close to a de-facto standard now.
Edit: I mean app engine, the hosted web service. Not the app store. Thanks.
I guess you are confusing the Google App Engine's App Gallery : http://appgallery.appspot.com/, which has been removed for some reasons and the Google Apps Marketplace : http://www.google.com/enterprise/marketplace, which is the actual App Store, where you could pay and install apps.
App Gallery was just a GAE application show-case center, and most likely was causing confusion to Google Apps customers too.
I am still a developer who trusts GAE (my app was on the appgallery and is also listed on marketplace) and believe that they will continue to compete for developer mind-share, as they proved yet again with this performance update.
Let go of the fear, uncertainty & doubt and hop on to try an app. You will like it too.
Also, I guess Google folks would post about the performance boost later.