Business Analytics (MSBA) Strategic Capstone

When searching for data on the web, you need to make sure that you include search terms relating to the content of the data you’re trying to find as well as some information on the format or source that you expect it to be in:

1. Searching by file type: Append your search with ‘filetype:XLS filetype:CSV’, geodata (‘filetype:shp’), or database extracts (‘filetype:MDB, filetype:SQL, filetype:DB’).
2. Search by part of a URL. Google: ‘inurl:downloads filetype:xls’ will find all Excel files that have “downloads” in their web address. You can also limit your search to only those results on a single domain name, by searching for, e.g. ‘site: agency.gov’.

1. http://usgovxml.com
2. http://aws.amazon.com/datasets
3. http://databib.org
4. http://datacite.org
5. http://figshare.com
6. http://linkeddata.org
7. http://reddit.com/r/datasets
8. http://thedatahub.org alias http://ckan.net
9. http://quandl.com
10. Social Network Analysis Interactive Dataset Library (Social Network Datasets)
11. Datasets for Data Mining
12. http://enigma.io

1. http://archive.ics.uci.edu/ml/
2. http://crawdad.org/
3. http://data.austintexas.gov
4. http://data.cityofchicago.org
5. http://data.govloop.com
6. http://data.gov.uk/
7. data.gov.in
8. http://data.medicare.gov
9. http://data.seattle.gov
10. http://data.sfgov.org
11. http://data.sunlightlabs.com
12. https://datamarket.azure.com/
13. http://developer.yahoo.com/geo/g...
14. http://econ.worldbank.org/datasets
15. http://en.wikipedia.org/wiki/Wik...
16.  http://factfinder.census.gov/ser...
17. http://ftp.ncbi.nih.gov/
18. http://gettingpastgo.socrata.com
19. http://googleresearch.blogspot.c...
20. http://books.google.com/ngrams/
21. http://medihal.archives-ouvertes.fr
22. http://public.resource.org/
23. http://rechercheisidore.fr
24. http://snap.stanford.edu/data/in...
25. http://timetric.com/public-data/
26. https://wist.echo.nasa.gov/~wist...
27. http://www2.jpl.nasa.gov/srtm
28. http://www.archives.gov/research...
29. http://www.bls.gov/
30. http://www.crunchbase.com/
31. http://www.dartmouthatlas.org/
32. http://www.data.gov/
33. http://www.datakc.org
34. http://dbpedia.org
35. http://www.delicious.com/jbaldwi...
36. http://www.faa.gov/data_research/
37. http://www.factual.com/
38. http://research.stlouisfed.org/f...
39. http://www.freebase.com/
40. http://www.google.com/publicdata...
41. http://www.guardian.co.uk/news/d...
42. http://www.infochimps.com
43. http://www.kaggle.com/
44. http://build.kiva.org/
45. http://www.nationalarchives.gov....
46. http://www.nyc.gov/html/datamine...
47. http://www.ordnancesurvey.co.uk/...
48. http://www.philwhln.com/how-to-g...
49. http://www.imdb.com/interfaces
50. http://imat-relpred.yandex.ru/en...
51. http://www.dados.gov.pt/pt/catal...
52. http://knoema.com
53. http://daten.berlin.de/
54. http://databib.org/
55. http://datacite.org/
56. http://data.reegle.info/
57. http://data.wien.gv.at/
58. http://data.gov.bc.ca
59. https://pslcdatashop.web.cmu.edu/ (interaction data in learning environments)
60. http://www.icpsr.umich.edu/icpsrweb/CPES/ - Collaborative Psychiatric Epidemiology Surveys: (A collection of three national surveys focused on each of the major ethnic groups to study psychiatric illnesses and health services use)
61. http://www.dati.gov.it
62. http://dati.trentino.it
63. http://www.databagg.com/
64. http://networkrepository.com - Network/ML data repository w/ visual interactive analytics
65. https://www.usafacts.org/ 

1. Gapminder: http://www.gapminder.org/data/
2. UMD:: http://inforumweb.umd.edu/econdata/econdata.html
3. World bank: http://data.worldbank.org/indicator
4. FRED database: St Louis Federal Reserve : http://research.stlouisfed.org/fred2/ 

1. This section contains data sets used in the book "Doing Data Science" by Rachel Schutt and Cathy O'Neil (O'Reilly 2014) Datasets on the book site: https://github.com/oreillymedia/doing_data_science
2. Enron Email Dataset: http://www.cs.cmu.edu/~enron/
3. Half a million Hubway rides: http://hubwaydatachallenge.org/trip-history-data/

1. BOE Futures Exchange: http://cfe.cboe.com/Data/
2. Google Finance: https://www.google.com/finance 
3. GoogleTrends: http://www.google.com/trends?q=google&ctab=0&geo=all&date=all&sort=0
4. NASDAQ: https://data.nasdaq.com/
5. OANDA: http://www.oanda.com/
6. Quandl: http://www.quandl.com/
7. Yahoo Finance: http://finance.yahoo.com/ (R)

1. Archived national government statistics: http://www.archive-it.org/
2. Australia: http://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/3301.02009?OpenDocument
3. Canada: http://www.data.gc.ca/default.asp?lang=En&n=5BCD274E-1
4. DataMarket: http://datamarket.com/
5. FDA: https://open.fda.gov/index.html
6. Guardian world governments: http://www.guardian.co.uk/world-government-data
7. HUD: http://www.huduser.org/portal/datasets/pdrdatas.html
8. London, U.K. data: http://data.london.gov.uk/catalogue
9. NYC data: http://nycplatform.socrata.com/
10. San Francisco Data sets: http://datasf.org/
11. U.K. Government Data: http://data.gov.uk/data
12. United Nations: http://data.un.org/
13. U.S. Federal Government Data Catalog: http://catalog.data.gov/dataset
14. U.S. Federal Government Agencies: http://www.data.gov/metric
15. US CDC Public Health datasets: http://www.cdc.gov/nchs/data_access/ftp_data.htm
16. The World Bank: http://wdronline.worldbank.org/

1. Gapminder: http://www.gapminder.org/data/
2. US department of Health and Services: (Largest collection of longitudinal hospital care data in the United States: http://www.ahrq.gov/research/data/dataresources/index.html

1. Peer to Peer lending data : lendingClub: https://www.lendingclub.com/info/download-data.action
2. Facebook Data: Complete set of Friends of various School networks: http://masonporter.blogspot.ae/2011/02/facebook100-data-set.html
3. Public Dataset on AWS: http://aws.amazon.com/public-data-sets/
4. Youtube Networks Dataset: http://netsg.cs.sfu.ca/youtubedata/
5. IMDB Dataset: http://www.imdb.com/interfaces
6. UCI – Machine Learning Dataset: http://archive.ics.uci.edu/ml/
7. Google Books n-gram dataset: http://aws.amazon.com/datasets/8172056142375670
8. Million song database: http://labrosa.ee.columbia.edu/millionsong/