Skip to content

Version 3.0.0

Latest
Latest
Compare
Choose a tag to compare
@pflooky pflooky released this 20 Oct 15:47
· 5 commits to main since this release
v3.0.0
51bffe2
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Highlights

  • New section: Support & communication channels.
  • New section: Servers.
  • Changes to fundamentals :
    • Rename uuid to id.
    • Add name.
    • Rename quantumName to dataProduct and make it optional.
    • Rename datasetDomain to domain (we avoid the dataset prefix).
    • Drop datasetKind (example: virtualDataset, was optional, have not seen any usage).
    • Drop userConsumptionMode (examples: analytical, was optional, already deprecated in v2.).
    • Drop sourceSystem (example: bigQuery, information will be encoded in servers).
    • Drop sourcePlatform (example: googleCloudPlatform, information will be encoded in servers).
    • Drop productSlackChannel (will move to support channels).
    • Drop productFeedbackUrl (will move to support channels).
    • Drop productDl (will move to support channels).
    • Drop username (credentials should not be stored in the data contract).
    • Drop password (credentials should not be stored in the data contract).
    • Drop driverVersion (will move to servers if needed).
    • Drop driver (will move to servers if needed).
    • Drop server (will move to servers if needed).
    • Drop project (BigQuery-specific, will move to servers).
    • Drop datasetName (BigQuery-specific, will move to servers).
    • Drop database (BigQuery-specific, will move to servers).
    • Drop schedulerAppName (not part of the contract).
  • Changes to Schema:
    • Major changes, check spec.
    • Adds support for non table formats, hierarchies, and arrays.
    • name is a new field
    • items is a new field
    • priorTableName is not supported anymore, if needed, consider a custom property.
    • table is not supported anymore, if needed, consider using name.
    • columns is now properties
    • dataGranularity is now dataGranularityDescription.
    • encryptedColumnNameis now encryptedName.
    • partitionStatus is now partitioned.
    • clusterStatus is not supported anymore, if needed, consider a custom property.
    • clusterKeyPosition is not supported anymore, if needed, consider a custom property.
    • sampleValues is now examples.
    • isNullable is now required.
    • isUnique is now unique.
    • isPrimaryKey is now primaryKey.
    • criticalDataElementStatus is now criticalDataElement.
    • clusterKeyPosition is not supported anymore, if needed, consider a custom property.
    • transformSourceTables is now transformSourceObjects
    • Restrict schema.*.logicalType to be one of string, date, number, integer, object, array, boolean.
    • Add schema.*.logicalTypeOptions.
  • Changes to Data Quality:
    • Significant changes have been applied to support more tools and use cases. Please review the new section.
    • If needed, templateName is a custom property.
    • toolName is obsolete, replaced by type=custom; engine: <engine name>.
    • scheduleCronExpression is replaced by schedule and scheduler. scheduleCronExpression: 0 20 * * * becomes schedule: 0 20 * * * and scheduler: cron.
  • #:
    • No changes.
  • Changes to Team (fka stakeholders):
    • Replaces stakeholders. Content stays the same.
  • Changes to Role:
    • Added description
    • Changed access is not required anymore
  • Security:
    • No changes.
  • Changes to SLA:
    • Starting with v3, the schema is not purely tables and columns, hence minor modifications: columns are now elements.
    • slaDefaultColumn is now slaDefaultElement.
    • column is now element.
    • Explicit reference to Data QoS.
  • Changes to custom and other properties:
    • systemInstance is not supported anymore, if needed, consider a custom property.

What's Changed

New Contributors

Full Changelog: v2.2.2...v3.0.0

Contributors

simonharrer, dirkvandepoel, and 5 other contributors
Assets 2
Loading