The heavy hitters of the internet might feel pretty good about themselves for figuring out how to handle big data sets, but national laboratories have been accustomed to managing exabyte-scale loads for years.
It would have been wise for developers at webscale properties to check with government supercomputing experts. Before the Hadoop Distributed File System and the Google File System hit the scene, there were things like Lustre and the Parallel Virtual File System, said Gary Grider, high-performance computing division leader at Los Alamos National Laboratory, at GigaOM’s Structure conference in San Francisco on Thursday.
To read the original article: Why webscale innovators should look beyond their bubble — Tech News and Analysis
