Quick guide to Snowflake Table Types Comparison

Quick guide to Snowflake Table Types Comparison

1. Permanent Table

  • Description: Standard, persistent storage for long-term data.
  • Usage: Ideal for primary business data needing frequent access and backups.
  • Durability: Full durability with time-travel and fail-safe.
  • Cost: Higher cost due to full data protection.
  • Create Table: CREATE TABLE my_permanent_table (id INT, name STRING);


2. Temporary Table

  • Description: Exists only for the duration of a session.
  • Usage: Useful for short-term data processing or transformations.
  • Durability: Dropped at session end, no time-travel.
  • Cost: Lower cost as no long-term storage.
  • Create Table: CREATE TEMPORARY TABLE my_temp_table (id INT, name STRING);


3. Transient Table

  • Description: Semi-persistent with no fail-safe protection.
  • Usage: Suitable for intermediate or staging data where recovery isn’t critical.
  • Durability: Retains data for session, limited time-travel.
  • Cost: Lower storage cost due to limited durability.
  • Create Table: CREATE TRANSIENT TABLE my_transient_table (id INT, name STRING);


4. External Table

  • Description: References external storage (e.g., S3, Azure Blob).
  • Usage: Accesses large, static data sets without loading into Snowflake.
  • Durability: No data storage in Snowflake.
  • Cost: Minimal storage cost; external data access fees.
  • Create Table: CREATE EXTERNAL TABLE my_external_table (id INT, name STRING) LOCATION=@my_s3_stage FILE_FORMAT=(TYPE=PARQUET);


5. Materialized View

  • Description: Stores results of a query with automatic updates.
  • Usage: Optimizes performance for frequent, complex queries, often used in analytics.
  • Durability: Updated with source data changes.
  • Cost: Potentially higher storage cost for fast access.
  • Create View: CREATE MATERIALIZED VIEW my_materialized_view AS SELECT * FROM my_table;


6. Iceberg Table

  • Description: Manages data as snapshots using a high-performance table format designed for big data (e.g., Parquet).
  • Usage: Ideal for large-scale analytics on data lakes and hybrid data warehousing setups.
  • Durability: Versioned snapshots for time-travel.
  • Cost: Efficient for large, unstructured datasets.
  • Create Table: CREATE TABLE my_iceberg_table USING iceberg LOCATION 's3://path/to/data' PARTITIONED BY (date);

要查看或添加评论,请登录

Jay Gandhi的更多文章

  • All about Snowflake's Result Caching feature

    All about Snowflake's Result Caching feature

    Boost Query Performance with Snowflake's Result Caching Snowflake is known for its ease of use and incredible…

  • Generative AI

    Generative AI

    What is Generative AI ? Type of AI that can generate images / videos / synthetic data / etc. via technology.

    4 条评论
  • Hiring !!!

    Hiring !!!

    We (Spaulding Ridge) are hiring, and I have a total of 5 positions to fill in my team (India). If you like to play…

    2 条评论
  • UiPath Automation Cloud - Web Studio for RPA Developers

    UiPath Automation Cloud - Web Studio for RPA Developers

    UiPath Web Studio Finally, the long awaited UiPath Studio on Web is ready for preview. Very similar to Automation…

  • UiPath Infra Requirements

    UiPath Infra Requirements

    UiPath Infra requirements If you are wondering what kind of Infra is required to setup UiPath – then this article is…

  • UiPath Salesforce Connector

    UiPath Salesforce Connector

    Did you know UiPath got a Salesforce connector ? Connector is like a backend API integrator. UiPath Salesforce…

    4 条评论
  • Used Python yet ? Set it up now

    Used Python yet ? Set it up now

    Here are few quick notes that may help you install Python & get you started – Download the Python software from here –…

  • What’s your story about Microsoft Power Automate Desktop?

    What’s your story about Microsoft Power Automate Desktop?

    What’s your story about MS Power Automate Desktop? I just installed the latest RPA offering from Microsoft – MS Power…

    1 条评论
  • Quick NO-PRO year end RPA/IA tip

    Quick NO-PRO year end RPA/IA tip

    Quick NO-PRO year end RPA/IA tip Not sure why am I writing this at this hour (3:00 am India Time). Planning to draw an…

    7 条评论
  • RPA – Build your first Automation Anywhere A2019 bot in less than 5 mins

    RPA – Build your first Automation Anywhere A2019 bot in less than 5 mins

    So, did you build your first bot yet using Automation Anywhere A2019? Or are you an RPA enthusiast and thinking where…

    3 条评论

社区洞察

其他会员也浏览了