feat: Support generating fake data with future SDK version

[ReubenFrankel]

Now meltano/sdk#2170 has been merged and once the next version of the SDK is released, it would be great to bump the singer-sdk version used here with the faker extra to leverage the new feature.

[edgarrmondragon]

@ReubenFrankel would you expect this package to enable the use of faker by default, i.e. depend directly on singer-sdk[faker], or would you prefer it to have its own extra?

I think I prefer on the former, since that makes this package more useful and it's presumably installed only once per project, unlike extractors.

[ReubenFrankel]

@edgarrmondragon Yep, I think by default is the most useful.

[maxmarcon]

Hi! I'm resurrecting this because I have a question (I'm relatively new to meltano).

Ok I wanted to use stream_maps with faker with tap-postgres. However, apparently, tap-postgres doesn't support faker (I get an error saying that the "fake object is not defined").

As a workaround, I'm using meltano-map-transform instead. fake is defined, however when I want to set the seed following this example from the Meltano SDK docs:

   - name: meltano-map-transformer
      config:
          stream_maps:
              data_platform_raw-tbii_daily_gmv_nmv:
                  tb_channel_id: Faker.seed(0) or fake.pyint()

I get an error:

'Faker' is not defined for expression 'Faker.seed(0) or fake.pyint()'

Do you know why? Thanks

[ReubenFrankel]

@maxmarcon Looks like that got added recently and will be included in the next SDK release. This plugin (and any other built with the SDK) will need to upgrade to the new version before what you are trying will work.

meltano/sdk@1333278

In the meantime, if you want to set a static seed, you can do this through faker_config.seed as in the docs example you linked, or in an expression with

   - name: meltano-map-transformer
      config:
          stream_maps:
              data_platform_raw-tbii_daily_gmv_nmv:
                  tb_channel_id: fake.seed_instance(0) and fake.pyint()

[maxmarcon]

Thanks @ReubenFrankel for the information. I was indeed able to find a workaround similar to the one you suggested:

fake.random.seed(self) or fake.pyint()

[edgarrmondragon]

I'll try to cut a release of the SDK today, and should follow shortly with a version bump here.