Skip to content

spark-utils 0.2.0
Compare
Choose a tag to compare
@jtcohen6 jtcohen6 released this 15 Apr 16:33
0.2.0
c380649
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

More Apache Spark "shims" for dbt_utils.

In particular, there is now full compatibility for all user-facing macros. Notably, it adds get_relations_by_pattern + get_relations_by_prefix. Note that the Spark implementations do not support schema name patterns, only relation name patterns with supported wildcards.

I don't believe there are any breaking changes relative to 0.1.0, but I'm bumping the minor version because:

  • I significantly reworked spark__split_part to support special characters
  • This package is still in early development + testing
Assets 2
Loading