Data Listings

This page contains a listing of all data products served by Pitt-Google Alert Broker and includes the connection information needed for access.

All data is served through public data repositories in Google Cloud. Pitt-Google’s Google Cloud project ID, which will be needed for access, is:

# Pitt-Google's Google Cloud project ID
ardent-cycling-243415

For examples of how to use the information on this page, please see our API Reference and User Demos repo.

Zwicky Transient Facility (ZTF)

ZTF is a wide-field, optical survey producing an alert stream at a rate of 10^5 - 10^6 per night.

Topic	Description
*Data Streams*
ztf-alerts	ZTF alert stream in Pub/Sub, cleaned of duplicate alerts. Messages contain the original alert bytes and metadata.
ztf-lite	Lite version of ztf-alerts (every alert, subset of fields).
ztf-tagged	ztf-lite with basic categorizations such as “is pure” and “is likely extragalactic transient” added to the message metadata to aid filtering.
ztf-SuperNNova	ztf-tagged plus SuperNNova classification results (Ia vs non-Ia).
*Notification Streams*
ztf-alert_avros	One message per alert indicating that the Avro file is available in a Cloud Storage bucket. The file and bucket names are in the message attributes. Messages contain no data.
ztf-BigQuery	One message per alert indicating that the alert data is available in a BigQuery table. Table names are in the message attributes. Messages contain no data.
*Testing Stream*
ztf-loop	Recent messages from the ztf-alerts stream, published at a rate of 1 per second. This stream is intended for testing and development use cases.

Dataset	Table	Description
ztf	alerts_v4_02	Alert data for ZTF schema version 4.02. This table is an archive of the ztf-alerts Pub/Sub stream, excluding image cutouts and metadata. It has the same schema as the original alert bytes (except cutouts), including nested and repeated fields. Equivalent tables exist for previous schema versions: alerts_v3_3, alerts_v3_1, alerts_v3_0, alerts_v1_8.
ztf	DIASource	ZTF alert data of the DIA source that triggered the alert. Includes the object ID and a list of source IDs for the previous sources included in the alert, excluding cutouts and data for previous sources. The schema is flat.
ztf	SuperNNova	Results from a SuperNNova (Möller & de Boissière, 2019) Type Ia supernova classification (binary).

Bucket	Description
ardent-cycling-243415-ztf_alerts_v4_02	Alert data for ZTF schema version 4.02. This bucket is an Avro file archive of the ztf-alerts Pub/Sub stream, including image cutouts and metadata. Each alert is stored as a separate Avro file. The filename syntax is: <ztf_topic>/<objectId>/<candid>.avro. Equivalent buckets exist for previous schema versions: v3_3, v3_1, v3_0, v1_8.

LVK is a gravitational wave collaboration producing an alert stream at a rate of 50 - 100 per day.

Topic	Description
*Data Streams*
lvk-alerts	LVK alert stream in Pub/Sub. Messages contain the original alert bytes and metadata.
lvk-BigQuery	One message per alert indicating that the alert data is available in a BigQuery table. Table names and alert metadata are in the message attributes. Messages contain no data.

Dataset	Table	Description
lvk	alerts_O4	Alert data from the LVK O4 observing run. This table is an archive of the lvk-alerts Pub/Sub stream. It has the same schema as the original alert bytes, including nested and repeated fields.