Skip to content

Add google-sheets-trigger Cloud Function #82

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
PhyllisHelton wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Add google-sheets-trigger Cloud Function #82

PhyllisHelton wants to merge 4 commits into from

Conversation

@PhyllisHelton
Copy link

@PhyllisHelton PhyllisHelton commented Jan 27, 2026

Summary

  • Adds a reusable HTTP Cloud Function () that monitors Google Sheets for changes via the Drive API and triggers dbt jobs when modifications are detected
  • Uses stateless 24-hour lookback (72 hours on Monday to cover weekends) with an optional parameter for daily schedules
  • Includes Terraform schedule configuration for the DW security sheets (3 sheets, dbt job 920201, M-F 7pm EST)
  • Updates README with service accounts, Pub/Sub topics, and google-sheets-trigger documentation

New files

    • HTTP handler with request validation, change detection, and Pub/Sub publishing
    • Google Drive API wrapper for retrieving sheet modifiedTime
    • 15 unit tests covering all logic paths
  • and
    • CI/CD workflow

Modified files

    • Added google-sheets-trigger module with dw_security_sheets schedule
    • Added Service Accounts, Pub/Sub Topics, and google-sheets-trigger sections
    • Added CLAUDE.local.md

Test plan

  • All 15 unit tests pass ()
  • Local integration test confirms Drive API access to all 3 Google Sheets with
  • Service account created and sheets shared
  • Drive API enabled
  • Test via Cloud Scheduler Force Run in POC environment after merge

PhyllisHelton and others added 4 commits January 27, 2026 10:24
@PhyllisHelton @claude
Add google-sheets-trigger Cloud Function
4185aed 
Reusable HTTP Cloud Function that monitors Google Sheets for changes
via the Google Drive API and triggers dbt jobs when modifications are
detected. Uses a stateless 24-hour lookback (72 hours on Monday to
cover weekends) with an optional include_weekends parameter.

Includes:
- HTTP handler with request validation and structured logging
- SheetsClient using Drive API with shared drive support
- Pub/Sub integration to trigger dbt jobs
- 15 unit tests covering all logic paths
- GitHub Actions CI/CD workflow
- Terraform schedule configuration for DW security sheets
- README documentation for service accounts, Pub/Sub, and usage

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@PhyllisHelton @claude
Add CLAUDE.local.md to gitignore
88ad7d1 
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@PhyllisHelton @claude
Change google-sheets-trigger schedule to 7pm EST
915a193 
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@PhyllisHelton @claude
Document environments and staging-based testing workflow
fb9e753 
Adds an Environments section to the README clarifying that staging
is the recommended testing environment, with step-by-step instructions.
Marks POC as experimental-only.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@PhyllisHelton