Qlik Replicate adds Snowpipe Streaming Support!

Let me show you how to set this up.

First, you have to create a API based connection to Snowflake for Replicate to use, this can be done via OAuth or Key Pair. I'm going to use Key Pair, but for those who like a challenge here is the link for setting up OAuth in Snowflake: https://docs.snowflake.com/en/user-guide/oauth-custom

So - on the the key pair setup! Full document here: https://docs.snowflake.com/en/user-guide/key-pair-auth#configuring-key-pair-authentication

Let's get our key pairs going, we will need a Private Key, and then a Public key based on that for setting up Replicate.

Step 1: Generate a Private Key

Open a terminal session in Mac/Linux or Command prompt in Windows (assuming OpepSSL is installed)

Run the following command to generate an Unencrypted Key (not recommended):

openssl genrsa 2048 | openssl pkcs8 -topk8 -inform PEM -out rsa_key.p8 -nocrypt

Or, better yet, Run the following command to generate an Encrypted Key (recommended):

openssl genrsa 2048 | openssl pkcs8 -topk8 -v2 des3 -inform PEM -out rsa_key.p8

You can of course use your own naming convention if you'd like.

Now that we have that file, we need to convert into a Public Key.

Step 2: Generate a Public Key

openssl rsa -in rsa_key.p8 -pubout -out rsa_key.pub

Yay - we now have the files we need to setup Qlik Replicate.

Step 3: Assign RSA Public Key to Replicate User

Open the RSA Public Key and copy all the code between the --PUBLIC KEY -- header/footer

Step 3: Assign Public Key to Snowflake User

Now open a Snowflake Worksheet and paste the text along side an Alter USER statement to assign the RSA Key to the user.

Now - it's very important: YOU NEED TO MAKE EVERYTHING IS IN ONE LINE OR THIS WON'T WORK... take all the spaces out from the pasted content so it's in one continuous line...

Run the command and then run desc user on the user to make sure the RSA key applied correctly.

Step 4: Copy Private Key to Qlik Replicate Server

Ok - we are all set, we need to copy the PRIVATE KEY over to the Qlik Replicate Server (doens't matter where as long as you know the path)

Step 5: Configure Qlik Replicate

Now we just fill out the details! Create a new Endpoint, use Snowflake (version of your choice, and select Key Pair for the Authentication Model, and under Data Loading, choose Snowpipe Streaming!

And TEST - and we have now added Snowpipe Streaming to your Qlik Replicate target!!!

Enjoy!