NIST BIG DATA PUBLIC WORKING GROUP BIG DATA USE CASE SURVEY

Publications:

  1. Judy Qiu, Shantenu Jha, Andre Luckow, and Geoffrey C.Fox, Towards HPC-ABDS: An Initial High-Performance Big Data Stack, in Building Robust Big Data Ecosystem ISO/IEC JTC 1 Study Group on Big Data. March 18-21, 2014. San Diego Supercomputer Center, San Diego. http://dsc.soic.indiana.edu/publications/nist-hpc-abds.pdf.
  2. Geoffrey Fox, Judy Qiu, and Shantenu Jha, High Performance High Functionality Big Data Software Stack, in Big Data and Extreme-scale Computing (BDEC). 2014. Fukuoka, Japan. http://www.exascale.org/bdec/sites/www.exascale.org.bdec/files/whitepapers/fox.pdf.
  3. Shantenu Jha, Judy Qiu, Andre Luckow, Pradeep Mantha, and Geoffrey C. Fox, A Tale of Two Data-Intensive Approaches: Applications, Architectures and Infrastructure, in 3rd International IEEE Congress on Big Data Application and Experience Track. June 27- July 2, 2014. Anchorage, Alaska. http://arxiv.org/abs/1403.1528.
  4. Geoffrey C.Fox, Shantenu Jha, Judy Qiu, and Andre Luckow, Towards an Understanding of Facets and Exemplars of Big Data Applications, in 20 Years of Beowulf: Workshop to Honor Thomas Sterling's 65th Birthday October 14, 2014. Annapolis http://dsc.soic.indiana.edu/publications/OgrePaperv9.pdf
  5. Geoffrey Fox and Wo Chang, Big Data Use Cases and Requirements, in 1st Big Data Interoperability Framework Workshop: Building Robust Big Data Ecosystem ISO/IEC JTC 1 Study Group on Big Data March 18 - 21, 2014. San Diego Supercomputer Center, San Diego. http://dsc.soic.indiana.edu/publications/NISTUseCase.pdf.
  6. NIST Big Data Use Case & Requirements. 2013 [accessed 2015 March 1]; Available from: http://bigdatawg.nist.gov/V1_output_docs.php.
  7. Geoffrey C. Fox, Shantenu Jha, Judy Qiu, and Andre Luckow, Ogres: A Systematic Approach to Big Data Benchmarks, in Big Data and Extreme-scale Computing (BDEC) January 29-30, 2015. Barcelona. http://www.exascale.org/bdec/sites/www.exascale.org.bdec/files/whitepapers/OgreFacets.pdf.
  8. Geoffrey C. FOX, Shantenu JHA, Judy QIU, Saliya EKANAYAKE, and Andre LUCKOW, Towards a Comprehensive Set of Big Data Benchmarks. February 15, 2015. http://dsc.soic.indiana.edu/publications/OgreFacetsv9.pdf.
  9. Dan Reed and Jack Dongarra. Exascale Computing and Big Data: The Next Frontier. 2014 [accessed 2015 March 8]; Available from: http://www.netlib.org/utk/people/JackDongarra/PAPERS/Exascale-Reed-Dongarra.pdf.
  10. Shantenu Jha, Andre Luckow, Pradeep Mantha, A Valid Abstraction for Data-Intensive Applications on HPC, Hadoop and Cloud Infrastructures? 2015. [Online]. Available: http://arxiv.org/abs/1501.05041
  11. Bingjing Zhang, Yang Ruan, and Judy Qiu, Harp: Collective Communication on Hadoop in IEEE International Conference on Cloud Engineering (IC2E). March 9-12, 2015. Tempe AZ. http://dsc.soic.indiana.edu/publications/HarpQiuZhang.pdf.
  12. Geoffrey Fox, Judy Qiu, Shantenu Jha, Supun Kamburugamuve and Andre Luckow, HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack Invited talk at 2nd International Workshop on Scalable Computing For Real-Time Big Data Applications (SCRAMBL'15) at CCGrid2015, the 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, held in Shenzhen, Guangdong, China http://dsc.soic.indiana.edu/publications/HPC-ABDSDescribed_final.pdf
  13. Geoffrey Fox, Judy Qiu, Shantenu Jha, Supun Kamburugamuve, and Andre Luckow, Implications of the HPC-ABDS High Performance Computing Enhanced Apache Big Data Stack for workflows, in White paper for DoE NGNS/CS Scientific Workflows Workshop http://extremescaleresearch.labworks.org/. April 20-21 2015. Rockville Md http://dsc.soic.indiana.edu/publications/WorkflowsandHPC-ABDS.pdf.

Kaleidoscope diagram