How do I download data from Spitzer?

The basics: Introduction and Terminology

Introduction

The Spitzer Heritage Archive (SHA) is the permanent home for all of the data collected during the Spitzer mission, plus all the documentation you need to understand it all. The SHA will eventually be formally part of IRSA's archive holdings. Right now (as of May 2010), the SHA is still being developed, though it is quite operational now. If you get started using it now, you may be able to influence some of the features that are incorporated! Right now, it contains most of the cryogenic Spitzer data.

The SHA is a web-based interface to the Spitzer archive, and it lives here: http://irsa.ipac.caltech.edu/applications/Spitzer/SHA/ Because it is web-based, you no longer need to download and install software that is platform-dependent. It should "just work" in whatever browser you use! There is online help for the SHA -- see the help menu in the upper right (of the red menu bar). There is no separate, downloadable User Guide yet. There will be.

The software that used to be the primary mechanism for pulling data from the archive is called Leopard. Leopard has some powerful visualization tools incorporated into it, and ultimately all of those same tools will be available from within the SHA, just with a different interface. (see "questions to think about" below!)

Basic Terminology

With the new interface comes some new terminology. Just in case you have been working with Spitzer data before, I'm including some of the older terms for these things. However, the newer terms are now supposed to be the primary terms for these things!

An individual Spitzer observation sequence is an AOR, or Astronomical Observation Request. In certain cases (often calibration or sometimes science observations), you may also see an IER, or Instrument Engineering Request. Either one involves many individual frames, as well as observer name, date of observation, object or area of the sky observed, and instrument used (IRAC, MIPS, or IRS)-- these are all part of the AOR. All of Spitzer's operations (planning, scheduling, processing) have been centered around these units (AORs or IERs). Now, for the SHA, we are starting to move away from that, but there are some things that are still only available on an AOR basis, so we really can't escape them.

The rest of the new terminology has its origin in other similar terms used in other archives. I know, I know, hard to think about astronomers using the same terms to mean the same thing across multiple telescopes and wavelengths! But we're trying...

Raw data that are fundamentally unprocessed are "Level 0" data. As NITARP folks, you should never encounter (or want to encounter, really) Level 0 data.

The individual data frames that emerge, calibrated, from the Spitzer pipeline are "Level 1," or "Basic Calibrated Data," or "BCDs." New with the SHA, you can now get just the BCDs from a region that you want; you no longer have to download the whole thing. As NITARP folks, you probably don't need these Level 1 data. But you might.

The products that come from combining these individual data frames (such as mosaics) are "Level 2," or "post-BCD," or "PBCD data." These still exist fundamentally on an AOR level, e.g., you can't get a Level 2 mosaic that is just a portion of an AOR. As NITARP folks, you probably want these data.

Not right now, but eventually, you will also be able to get "Level 3" data through this interface. These products will be supplemental data that are produced either by the SSC or donated to us by professional astronomers, and represent additional processing. For example, a Level 3 mosaic might combine data from 7 AORs into one big mosaic, with customized (as opposed to hands-off pipeline) processing of image artifacts. If you are familiar with the Legacy Enhanced Products, these are also examples of Level 3 data. Right now, you need to go through other IRSA channels (see below) to get to these products. As soon as these data are available, and if they are available for the object(s) you are studying, as NITARP folks, these are the data you're probably going to want.

All of the images come in FITS format. (Wondering what is FITS format?) (If you are really savvy, you might also care that they are mostly single-plane FITS files. Some Level 3 products will be/are multi-plane FITS.) The other format for some data is IPAC table files (.tbl extension). IPAC table format is really just plain text, with a special header. Once you get a file like this, just about anything (including Excel) can read it.

Downloading Data: Using the SHA, short version

Coming soon

Downloading Data: Using the SHA, long version

In gory detail!

Downloading Data: Using the SHA, a concrete example

Originally developed especially for the 2010 CG4 team.

Downloading Data: How can I find already-reduced Spitzer data?

Including polished mosaics and source lists! (This page has indeed been updated to include the new SSC website links; SHA doesn't provide its own interface to Legacy data...yet. --Rebull 12:14, 27 April 2010 (PDT))

************I STOPPED EDITING HERE*************

Visualize AOR using Leopard (optional but useful if truly new at this)

The point of this is to see specifically where the telescope will be/was pointed for a given observation. If you have an observation that is a big mosaic, you can see where each individual pointing fell. This helps you understand why you have so many files when you download Spitzer data.

1. From Leopard's main window, select an AOR.
2. Under the Images menu, choose ISSA, and select a 5 degree image in the wavelength of your choice (25, 60, 100, 160 microns).
3. Under the Overlays menu, choose "AORs on image." (5th from the bottom on the Overlays menu.) Depending on your wavelength, each colored box may result in one or two data frames, each of which is a file you get from Leopard, as well as scads of associated files for each of those frames! (Note that there are lots of other overlay options to explore, and we encourage you to do so, but if you want to see where your observations fall on the sky, you need to pick "AORs on image.")

There is more information on visualization in the Spot and Leopard User's Guides.

Downloading Data: How can I find any prior observations for an object?

Has a particular target ever been observed with any of Spitzer's instruments? Or, would this target be a good proposal for a new project?

Downloading Data: How can I quickly get a mosaic of my object?

Get me a mosaic, quick! Don't bother me with preambles or complete explanations, I just want a picture. (Also see What is a mosaic and why should I care?)

Downloading Data: I need the image as a FITS file, how can I get this?

OK, I'm ready for a real fits file that doesn't have any losses due to compression.

Downloading Data: What should I do if there is more than one mosaic of the same object?

What to do if there is more than one imaging observation of your favorite target. Includes an example for finding the best possible image of a target, M16. If you have more than one image of a target that you need to combine, this naturally leads into mosaicking. An example is given for the ONC, including a link explaining how to combine (mosaic) the images.

Downloading Data: How can I get a spectrum of my object?

Spitzer is more than just imaging -- IRS and MIPS take spectra as well as images.

Downloading Data: I'm ready to advance to a highly technical and in-depth discussion on downloading Spitzer data.

This tells you how to start from the same place professional astronomers do. You will have to learn how to mosaic frames using the Spitzer tools developed for professional astronomers by the Spitzer Science Center. This needs a lot of disk space, and, well, a little bit of courage! And access to IDL would help a lot.

Questions to think about and things to try with Spot/Leopard

• This item is easiest to do with Leopard. Pick an object to search on, anything you want.
  • Which program(s) (if any) have observations? With which instruments?
  • Who requested the observations? (bonus: What are they investigating?)
  • Has Spitzer observed it yet?
  • When are the data going to be available to download? If they are available, download the post-BCD mosaics.
• Try the questions on this page using Spitzer data for the three color planes.
• This item can be done with Spot or Leopard, perhaps slightly easier with Spot than Leopard. You might find it useful to consult "Using Spot to get data from other wavelengths". For a given object, whether or not you can find Spitzer data, find images of the object from another mission or survey, in another (non-Spitzer) wavelength.
  • What wavelength(s) did you pick?
  • What features are more apparent in the other wavelength compared to Spitzer? Are there other differences?
• This item can be done with Spot or Leopard, perhaps slightly easier with Spot than Leopard. For a given object, on top of one of those images of an object from another mission or survey, pick a catalog (such as IRAS) to overlay on the image. Figure out how to just have it show the brightest or just the faintest things. Warning: if you choose to overlay the 2mass catalog over a large region, you will be waiting for several minutes while the computer renders many 1000s of points.
  • What other catalog(s) at what other wavelength(s) did you pick?
  • Were there a lot of sources in the region you picked, in the catalog you picked? Why? (You may wish to pick another catalog for comparison.)

Come up with your own answers and then discuss downloading data.

Possibly useful resources

• Leopard pocket guide
• Spot pocket guide
• Leopard User's Guide
• Spot User's Guide