Skip to content

Latest commit

 

History

History
61 lines (50 loc) · 3.32 KB

README.md

File metadata and controls

61 lines (50 loc) · 3.32 KB

Cloud Data Loss Prevention (DLP) API Samples

Open in Cloud Shell

The Data Loss Prevention API provides programmatic access to a powerful detection engine for personally identifiable information and other privacy-sensitive data in unstructured data streams.

Setup

  • A Google Cloud project with billing enabled
  • Enable the DLP API.
  • Create a service account and set the GOOGLE_APPLICATION_CREDENTIALS environment variable pointing to the downloaded credentials file.

Running

To run a specific sample, edit any variables under the TODO(developer): in the function at the top of each sample, and then execute the function as convenient.

For example, if using the command line you might use the following (replacing <CLASS_NAME> with the name of the sample):

mvn exec:java -Dexec.mainClass="dlp.snippets.<CLASS_NAME>"

Testing

Setup

  • Ensure that GOOGLE_APPLICATION_CREDENTIALS points to authorized service account credentials file.
  • Set the DLP_DEID_WRAPPED_KEY environment variable to an AES-256 key encrypted ('wrapped') with a Cloud Key Management Service (KMS) key.
  • Set the DLP_DEID_KEY_NAME environment variable to the path-name of the Cloud KMS key you wrapped DLP_DEID_WRAPPED_KEY with.
  • Create a Google Cloud Storage bucket and upload test.txt.
    • Set the GCS_PATH environment variable to point to the path for the bucket.
  • Copy and paste the data below into a CSV file and create a BigQuery table from the file: 
    Name,TelephoneNumber,Mystery,Age,Gender
James,(567) 890-1234,8291 3627 8250 1234,19,Male
Gandalf,(223) 456-7890,4231 5555 6781 9876,27,Male
Dumbledore,(313) 337-1337,6291 8765 1095 7629,27,Male
Joe,(452) 223-1234,3782 2288 1166 3030,35,Male
Marie,(452) 223-1234,8291 3627 8250 1234,35,Female
Carrie,(567) 890-1234,2253 5218 4251 4526,35,Female
    • Set the BIGQUERY_DATASET and BIGQUERY_TABLE environment values.
  • Create a Google Cloud Pub/Sub topic and and a subscription that is subscribed to the topic.
    • Set the PUB_SUB_TOPIC and PUB_SUB_SUBSCRIPTION environment variables to the corresponding values.
  • Create a Google Cloud Datastore kind and add an entity with properties:
  • Update the Datastore kind in InspectTests.java.
  • Create a Google Cloud Datastore entity and provide namespace and kind values.
    • Set the environment variables DLP_NAMESPACE_ID and DLP_DATASTORE_KIND with the values provided in above step.

Run

Run all tests:

   mvn clean verify