Skip to main content

Google App Engine

Google App Engine (often referred to as GAE or simply App Engine) is a platform as a service (PaaS) cloud computing platform for developing and hosting web applications in Google-managed data centers. Applications are sandboxed and run across multiple servers.[1] App Engine offers automatic scaling for web applications—as the number of requests increases for an application, App Engine automatically allocates more resources for the web application to handle the additional demand.[2]
Google App Engine is free up to a certain level of consumed resources. Fees are charged for additional storage, bandwidth, or instance hours required by the application.[3] It was first released as a preview version in April 2008, and came out of preview in September 2011.

Supported features/restrictions

Runtimes and frameworks

Currently, the supported programming languages are Python, Java (and, by extension, other JVM languages such as Groovy, JRuby, Scala, Clojure and PHP via a special version of Quercus), Go, and PHP. Go and PHP are in experimental status.[4] Google has said that it plans to support more languages in the future, and that the Google App Engine has been written to be language independent. [5]
Python web frameworks that run on Google App Engine include GAE framework,[6] Django, CherryPy, Pyramid, Flask, web2py and webapp2,[7] as well as a custom Google-written webapp framework and several others designed specifically for the platform that emerged since the release.[8] Any Python framework that supports the WSGI using the CGI adapter can be used to create an application; the framework can be uploaded with the developed application. Third-party libraries written in pure Python may also be uploaded.[9][10]
Google App Engine supports many Java standards and frameworks. Core to this is the servlet 2.5 technology using the open-source Jetty Web Server,[11] along with accompanying technologies such as JSP. JavaServer Faces operates with some workarounds. Though the datastore used may be unfamiliar to programmers, it is easily accessed and supported with JPA. JDO and other methods of reading and writing data are also provided. The Spring Framework works with GAE, however the Spring Security module (if used) requires workarounds. Apache Struts 1 is supported, and Struts 2 runs with workarounds.[12]
The Django web framework and applications running on it can be used on App Engine with modification. Django-nonrel[13] aims to allow Django to work with non-relational databases and the project includes support for App Engine.[14]
Applications developed for the Grails web application framework was meant to be modified and deployed to Google App Engine with very little effort using the App Engine Plugin,[15] but is no more because grails GAE plugin project is pretty dead.

Reliability and Support

All billed High-Replication Datastore App Engine applications have a 99.95% uptime SLA.[16]
App Engine is designed in such a way that it can sustain multiple datacenter outages without any downtime. This resilience to downtime is shown by the statistic that the High Replication Datastore saw 0% downtime over a period of a year. [17]
Paid support from Google engineers is offered as part of Premier Accounts.[18] Free support is offered in the App Engine Groups and Stack Overflow, however assistance by a Google staff member is not guaranteed.

API List

Trusted Tester

  • Monitoring API

Experimental

  • Cloud Endpoints
  • Google Cloud Storage API (Python)
  • Files API (Python, Java, Go)
  • Full Text Search API
  • Mapreduce API (Python)
  • Prospective Search API (Python, Java)
  • ProtoRPC API (Python)
  • Task Queue REST API (Python, Java)
  • OAuth API (Python, Java, Go)
  • OpenID (Python, Java, Go)
  • App Identity API (Python, Java)

Production

  • Blobstore API (Python, Java, Go)
  • Capabilities API (Python, Java, Go)
  • Channel API (Python, Java, Go)
  • Datastore API (Python, Java, Go)
  • Datastore Async API (Python, Java)
  • Images API (Python, Java, Go)
  • Log Service API (Python, Go)
  • Mail API (Python, Java, Go)
  • Memcache API (Python, Java, Go)
  • Multitenancy API (Python, Java)
  • Remote API (Java)
  • SSL access on custom domains
  • Task Queue API (Python, Java, Go)
  • URLFetch API (Python, Java, Go)
  • Users API (Python, Java, Go)
  • XMPP API (Python, Java, Go)

Bulk downloading

SDK version 1.2.2 adds support for bulk downloads of data using Python.[19] The open source Python projects gaebar, [20] approcket,[21] and gawsh[22] also allow users to download and backup App Engine data. No method for bulk downloading data from GAE using Java currently exists.

Restrictions

  • Developers have read-only access to the filesystem on App Engine. Applications can use only virtual filesystems, like gae-filestore.[23]
  • App Engine can only execute code called from an HTTP request (scheduled background tasks allow for self calling HTTP requests).
  • Users may upload arbitrary Python modules, but only if they are pure-Python; C and Pyrex modules are not supported.
  • Java applications may only use a subset (The JRE Class White List) of the classes from the JRE standard edition.[24]
  • Does not support 'naked' domains (without www) like http://example.com. The required alias to ghs.google.com is implemented with a DNS CNAME record in order for changes in Google server IP addresses not to impact the service. This record cannot be used with other DNS records (RFC 1034 section 3.6.2, RFC 1912 section 2.4), including the required Start of Authority for the example.com DNS zone. Suggested workaround is to use the domain registrar HTTP redirection to a subdomain, e.g. "www.example.com".[25]
  • Datastore cannot use inequality filters on more than one entity property per query.[26]
  • A process started on the server to answer a request can't last more than 60 seconds (with the 1.4.0 release, this restriction does not apply to background jobs anymore).
  • Does not support sticky sessions (a.k.a. session affinity), only replicated sessions are supported including limitation of the amount of data being serialized and time for session serialization.

Major differences

Differences with other application hosting

Compared to other scalable hosting services such as Amazon EC2, App Engine provides more infrastructure to make it easy to write scalable applications, but can only run a limited range of applications designed for that infrastructure.
App Engine's infrastructure removes many of the system administration and development challenges of building applications to scale to hundreds of requests per second and beyond.[27] Google handles deploying code to a cluster, monitoring, failover, and launching application instances as necessary.
While other services let users install and configure nearly any *NIX compatible software, App Engine requires developers to use only its supported languages, APIs, and frameworks. Current APIs allow storing and retrieving data from a BigTable non-relational database; making HTTP requests; sending e-mail; manipulating images; and caching. Existing web applications that require a relational database will not run on App Engine without modification.
Per-day and per-minute quotas restrict bandwidth and CPU use, number of requests served, number of concurrent requests, and calls to the various APIs, and individual requests are terminated if they take more than 60 seconds or return more than 32MB of data.

Differences between SQL and GQL

Google App Engine's datastore has a SQL-like syntax called "GQL". GQL intentionally does not support the Join statement, because it seems to be inefficient when queries span more than one machine.[28] Instead, one-to-many and many-to-many relationships can be accomplished using ReferenceProperty().[29] This shared-nothing approach allows disks to fail without the system failing.[30] Switching from a relational database to the Datastore requires a paradigm shift for developers when modelling their data.
Unlike a relational database the Datastore API is not relational in the SQL sense.
The Java version supports asynchronous non-blocking queries using the Twig Object Datastore[31] interface. This offers an alternative to using threads for parallel data processing.

Portability concerns

Developers worry that the applications will not be portable from App Engine and fear being locked into the technology.[32] In response, there are a number of projects to create open-source back-ends for the various proprietary/closed APIs of app engine, especially the datastore. Although these projects are at various levels of maturity, none of them are at the point where installing and running an App Engine app is as simple as it is on Google's service.[33] AppScale and TyphoonAE[34] are two of the open source efforts.
AppScale can run Python, Java, and Go GAE applications on EC2 and other cloud vendors.
TyphoonAE[34] can run python App Engine applications on any cloud that support linux machines.
Web2py web framework offers migration between SQL Databases and Google App Engine, however it doesn't support several App Engine-specific features such as transactions and namespaces.[35]

Backends

In Google I/O 2011, Google announced App Engine Backends, which are allowed to run continuously, and consume more memory. [36][37]

Google Cloud SQL

In Oct 2011, Google previewed a zero maintenance SQL database, which supports JDBC and DB-API.[38] This service allows to create, configure, and use relational databases with App Engine applications. The database engine is MySql Version 5.1.59 and the database size must be no larger than 10GB.[39]

Usage quotas

Google App Engine requires a Google account to get started, and an account may allow the developer to register up to 10 applications. This limit can be increased by Google staff.
Google App Engine defines usage quotas for free applications. Extensions to these quotas can be requested, and application authors can pay for additional resources.[40] Below are limit and quotas defined per application:

Hard limits

Quota Limit
Time per request 60 sec per normal request, 10 minutes for tasks, unlimited for backends
HTTP response size 32 MB
Datastore item size 1 MB

Free quotas

Application creators who enable billing pay only for instance hours, bandwidth, storage, and API usage in excess of the free quotas. Free quotas were reduced on May 25, 2009,[41] reduced again on June 22, 2009.[41] but then revised in May 2011 to allow for more infrastructure and pricing changes.[42][43]
Quota Limit (per day)
Instance-hours 28 hours
Emails 100 (5000 admin emails)
Bandwidth in Unlimited
Bandwidth out 1 GB
Datastore 1 GB
Datastore Operations 50k
Blob Storage 5 GB
XMPP API 10k stanzas
Channel API 100 channels opened
URLFetch API calls per day 657,000

Comments

Popular posts from this blog

OWASP Top 10 Threats and Mitigations Exam - Single Select

Last updated 4 Aug 11 Course Title: OWASP Top 10 Threats and Mitigation Exam Questions - Single Select 1) Which of the following consequences is most likely to occur due to an injection attack? Spoofing Cross-site request forgery Denial of service   Correct Insecure direct object references 2) Your application is created using a language that does not support a clear distinction between code and data. Which vulnerability is most likely to occur in your application? Injection   Correct Insecure direct object references Failure to restrict URL access Insufficient transport layer protection 3) Which of the following scenarios is most likely to cause an injection attack? Unvalidated input is embedded in an instruction stream.   Correct Unvalidated input can be distinguished from valid instructions. A Web application does not validate a client’s access to a resource. A Web action performs an operation on behalf of the user without checking a shared sec

CKA Simulator Kubernetes 1.22

  https://killer.sh Pre Setup Once you've gained access to your terminal it might be wise to spend ~1 minute to setup your environment. You could set these: alias k = kubectl                         # will already be pre-configured export do = "--dry-run=client -o yaml"     # k get pod x $do export now = "--force --grace-period 0"   # k delete pod x $now Vim To make vim use 2 spaces for a tab edit ~/.vimrc to contain: set tabstop=2 set expandtab set shiftwidth=2 More setup suggestions are in the tips section .     Question 1 | Contexts Task weight: 1%   You have access to multiple clusters from your main terminal through kubectl contexts. Write all those context names into /opt/course/1/contexts . Next write a command to display the current context into /opt/course/1/context_default_kubectl.sh , the command should use kubectl . Finally write a second command doing the same thing into /opt/course/1/context_default_no_kubectl.sh , but without the use of k

标 题: 关于Daniel Guo 律师

发信人: q123452017 (水天一色), 信区: I140 标  题: 关于Daniel Guo 律师 关键字: Daniel Guo 发信站: BBS 未名空间站 (Thu Apr 26 02:11:35 2018, 美东) 这些是lz根据亲身经历在 Immigration版上发的帖以及一些关于Daniel Guo 律师的回 帖,希望大家不要被一些马甲帖广告帖所骗,慎重考虑选择律师。 WG 和Guo两家律师对比 1. fully refund的合约上的区别 wegreened家是case不过只要第二次没有file就可以fully refund。郭家是要两次case 没过才给refund,而且只要第二次pl draft好律师就可以不退任何律师费。 2. 回信速度 wegreened家一般24小时内回信。郭律师是在可以快速回复的时候才回复很快,对于需 要时间回复或者是不愿意给出确切答复的时候就回复的比较慢。 比如:lz问过郭律师他们律所在nsc区域最近eb1a的通过率,大家也知道nsc现在杀手如 云,但是郭律师过了两天只回复说让秘书update最近的case然后去网页上查,但是上面 并没有写明tsc还是nsc。 lz还问过郭律师关于准备ps (他要求的文件)的一些问题,模版上有的东西不是很清 楚,但是他一般就是把模版上的东西再copy一遍发过来。 3. 材料区别 (推荐信) 因为我只收到郭律师写的推荐信,所以可以比下两家推荐信 wegreened家推荐信写的比较长,而且每封推荐信会用不同的语气和风格,会包含lz写 的research summary里面的某个方面 郭家四封推荐信都是一个格式,一种语气,连地址,信的称呼都是一样的,怎么看四封 推荐信都是同一个人写出来的。套路基本都是第一段目的,第二段介绍推荐人,第三段 某篇或几篇文章的abstract,最后结论 4. 前期材料准备 wegreened家要按照他们的模版准备一个十几页的research summary。 郭律师在签约之前说的是只需要准备五页左右的summary,但是在lz签完约收到推荐信 ,郭律师又发来一个很长的ps要lz自己填,而且和pl的格式基本差不多。 总结下来,申请自己上心最重要。但是如果选律师,lz更倾向于wegreened,