I'm currently developing an open-source framework that allows theoretically infinite scalability utilizing round-robin dns, S3, EC2, S3DFS (allows mounting an S3 bucket as a local file system on multiple EC2 instances), SQLite (serverless embeddable database where each db is just a flat file).
S3DFS works at the block level and has read/write caching so is really fast. However, it requires a commercial license for non-personal use.
SQLite is amazing in it's power and simplicity. It will start to have issues on a high-traffic website, but I'm breaking each user into their own db file. That sounds really bad - but SQLite has a great feature that allows you to attach multiple databases together and run queries across them as if it's just one database (handy for site-wide stats, search indexing, etc). Also, since the db's are just flat-files - backing up is super-easy with tar gzip!
I'm using PHP for the coding, but anticipate other languages libraries to be built to use the system as well.
Help is welcome, just let me know if you're interested!
I was thinking of calling it infinizon - but that sounds kinda dorky - thoughts?
Update: I just came across http://rightscale.com which is an amazing AWS console that allows you to control almost all aspects of EC2, S3, and SQS. Too many features to list here, but definitely a must see. I've been playing around with it and it works great.
I'm currently developing an open-source framework that allows theoretically infinite scalability utilizing round-robin dns, S3, EC2, S3DFS (allows mounting an S3 bucket as a local file system on multiple EC2 instances), SQLite (serverless embeddable database where each db is just a flat file).
S3DFS works at the block level and has read/write caching so is really fast. However, it requires a commercial license for non-personal use.
SQLite is amazing in it's power and simplicity. It will start to have issues on a high-traffic website, but I'm breaking each user into their own db file. That sounds really bad - but SQLite has a great feature that allows you to attach multiple databases together and run queries across them as if it's just one database (handy for site-wide stats, search indexing, etc). Also, since the db's are just flat-files - backing up is super-easy with tar gzip!
I'm using PHP for the coding, but anticipate other languages libraries to be built to use the system as well.
Help is welcome, just let me know if you're interested!
I was thinking of calling it infinizon - but that sounds kinda dorky - thoughts?
http://www.sqlite.org/
http://www.openfount.com/blog/s3dfs-for-ec2
Update: I just came across http://rightscale.com which is an amazing AWS console that allows you to control almost all aspects of EC2, S3, and SQS. Too many features to list here, but definitely a must see. I've been playing around with it and it works great.