Skip to content

Site components

Jump to bottom
Aaron D Borden edited this page May 21, 2020 · 24 revisions

This is a description of all the components make up data.gov.

www.data.gov

Wordpress site. This is the front page of Data.gov and contains resources for the public and agencies about Open Data.

Instance Url
Production www.data.gov
Staging wordpress-datagov.dev-ocsit.bsp.gsa.gov
CI wordpress.ci.datagov.us

catalog.data.gov

CKAN app containing an index (or catalog) for many Federal, State, and Municipal datasets.

Instance Url
Production catalog.data.gov
Staging catalog-datagov.dev-ocsit.bsp.gsa.gov
CI catalog.ci.datagov.us

Subcomponents

  • ckan

Services

Catalog consumes these services:

  • apache2
  • rds
  • redis
  • solr

CSW (PyCSW)

CSW or PyCSW provides the Catalog Service for Web (CSW) API for accessing geospatial metadata contained in the CKAN Catalog. A nightly job imports all datasets from CKAN. Historically, it has been treated as a component of Catalog, but it should function as its own application with a dependency on Catalog.

CSW comes in two flavors, csw-all (/csw-all) and csw-collection (/csw). csw-all exposes all 3+ million datasets while csw-collection only exposes the top-level Collections.

Instance Url
Production catalog.data.gov/csw
Staging catalog-datagov.dev-ocsit.bsp.gsa.gov/csw
CI catalog.ci.datagov.us/csw

Subcomponents

  • pycsw

Services

  • Catalog
  • apache2
  • rds

inventory.data.gov

Used by federal agencies to manage metadata for their datasets. Inventory is used to generate the agency's data.json.

Subcomponents

  • ckan
  • datapusher

Services

Inventory consumes these services:

  • apache2
  • rds
  • redis
  • solr
Instance Url
Production inventory.data.gov
Staging inventory-datagov.dev-ocsit.bsp.gsa.gov
CI inventory.ci.datagov.us

CRM

The public Data.gov Help Desk (customer relationship management) system. Issues with datasets, requests for datasets, and general questions are submitted here. We are in the process of phasing out CRM.

Instance Url
Production labs.data.gov/crm
Staging crm-datagov.dev-ocsit.bsp.gsa.gov
CI crm.ci.datagov.us

Dashboard

Dashboard from Project Open Data scans the 24 CFO act agency for compliance with M-13-13. This system needs work to meet the Open Government Data Act.

Instance Url
Production labs.data.gov/dashboard
Staging dashboard-datagov.dev-ocsit.bsp.gsa.gov
CI dashboard.ci.datagov.us

Static sites

These static sites are hosted on Federalist.

Clone this wiki locally