Provide data resources that allows to query all jobs from within a project and or environment

[mlavaert]

Currently there is only a data object to get information from a single job. I would need to be able to query all jobs that exist in the production environment.

My use case:

• I want to attach webhooks and notifications to jobs created outside of Terraform. Some teams have developer permissions allowing them to create their own jobs without going throughus.

[b-per]

Thanks for raising this!

I actually got the same feedback a few days ago from another user of the provider.

My first answer was to provide an example with the http datasource.

data "http" "my_jobs" {
  url = "https://emea.dbt.com/api/v2/accounts/<your-account-id>/jobs/?project_id=<your-project-id>&include_related=[environment]"

  request_headers = {
    Authorization = "Bearer ${var.dbt_token}"
  }
}

locals {
  my_jobs = jsondecode(data.http.my_jobs.response_body)
  my_jobs_prod = [for job in local.my_jobs.data : job if job.environment.deployment_type == "production"]
}

With the caveat that it will only return the first 100 jobs and will not work if there are more than 100 jobs in a given project.

But I am planning in adding a new datasource for dbtcloud_jobs.
What parameters would be useful for you? I was thinking of allowing filtering the data source byproject_id or environment_id.

[mlavaert]

That would work! TY

[b-per]

dbtcloud_jobs is available in 0.3.10 that is getting released