What does it take to run imgur.com?
imgur.com is a popular image hosting website used by several twitter clients and tools by defauly. But what does it take to run a no frills image hosting site like imgur?
As per imgur stats page, the service is now averaging up to 40TB of data each day and averages up to 255 million image views [...]
Huge datasets
Looking for big huge datasets to play with? Peter Skomoroch maintains a delicious bookmark on datasets which he’s been updating since 2007. From NCDC weather data, to wikipedia traffic dumps, to amazon public datasets — you’ll certainly find something interesting there.
With cheap computing power easily available for hire, crunching huge datasets isn’t limited to just big [...]