Export Dialogflow conversations to BigQuery after masking SPII data using DLP API
Dialogflow Fulfillment mechanism is used to intercept all the conversations using a webhook (deployed as a GAE app). The conversations are logged asynchronously after masking the PII data using Google App Engine and DLP API to a PubSub topic. From there each conversation is then inserted into BigQuery using Dataflow job. (#streaming inserts to BQ)
Please feel free to contribute to the code base by submitting a pull request.