Early Data Release

In July 2014 we released the first set of data available from the Dark Sky Simulations, encapsulating both our first trillion particle simulation, ds14_a, and the ds14_g simulations that fill out a suite of simulations covering a range of 1000 in particle mass. The best way to browse the data is your favorite web browser. Head on over to http://darksky.slac.stanford.edu/data_release. The README has a great introduction on how to start interacting with the data. Just beware of clicking on those 34 TB files!

Now that the Chrome coLaboratory App has been released and packaged up with yt and the darksky_catalog, if you install the app you can get a one-click access to the data! Check out the examples here.

Data Access

We provide open access to our raw data products, without authentication. In order to provide remote access to petascale datasets, we've developed thingking, a page-caching system capable of injecting raw binary data from the WWW into locally running Python sessions in the form of Numpy arrays. For more info, check out the examples.

Through this interface, we maintain a catalog of simulation data products that can be loaded on-demand through the yt project. Individuals are also encourange to simply browse the available data. Just beware of clicking on those 34 TB files!

import yt
from darksky_catalog import darksky
ds = darksky["ds14_a"].load()
p = yt.ProjectionPlot(ds, 0, 'dark_matter')

import yt
ds14_a = yt.load("http://darksky.slac.stanford.edu/simulations/ds14_a/ds14_a_1.0000")
print "Number of particles: %i" % ds14_a['npart']

yt : [INFO     ] 2014-07-06 17:34:47,960 Parameters: current_time              = 4.34205871754e+17 code_time
yt : [INFO     ] 2014-07-06 17:34:47,960 Parameters: domain_dimensions         = [2 2 2]
yt : [INFO     ] 2014-07-06 17:34:47,960 Parameters: domain_left_edge          = [-5813429.5 -5813429.5 -5813429.5] code_length
yt : [INFO     ] 2014-07-06 17:34:47,961 Parameters: domain_right_edge         = [ 5813429.5  5813429.5  5813429.5] code_length
yt : [INFO     ] 2014-07-06 17:34:47,962 Parameters: cosmological_simulation   = 1
yt : [INFO     ] 2014-07-06 17:34:47,962 Parameters: current_redshift          = 0.0
yt : [INFO     ] 2014-07-06 17:34:47,962 Parameters: omega_lambda              = 0.704873782167
yt : [INFO     ] 2014-07-06 17:34:47,962 Parameters: omega_matter              = 0.295126217833
yt : [INFO     ] 2014-07-06 17:34:47,962 Parameters: hubble_constant           = 0.688062
Number of particles: 1073741824000

You can also access reduced data products such as the halo mass function histograms. For example, you can use mass_function.py to re-create a mass function comparison plot like was done in the Early Data Release paper.

Raw Datasets

Raw particles and halos can be browsed directly at http://darksky.slac.stanford.edu/simulations/