Try new tech

As someone who works in data, you need to keep track of the technologies. Things like Snowflake, Databricks, BigQuery, Fabric, Qlik, S3, ADF, Fivetran, Matillion, Dataiku, Collibra, etc. Sometimes I heard people said "I don't have access". That is no excuse. You can try almost any technology for free. All vendors are competing for our attention. Whether you are a developer, an analyst, an architect or a consultant, all technology providers want you to know them. Whether they work in databases, data integration or data management, they all want you to try their products. All you need to do is go to their websites, like Snowflake.com, Databricks.com, Qlik.com, Dataiku.com, Tableau.com and click on Try for Free. They all have free trial.

Be careful when you want to try out Looker (it's like Power BI and Tableau, from Google). You need to disable the API otherwise you could be charged with thousands of dollars. If this happens contact their customer service asap and they will be able to reverse that charge out.

There is no excuse for not trying out new technologies. We are not in electrical engineering, nor construction industry, where the technologies move at glacier pace. We are in the information technology, where things move so quickly that you if blink you'll miss it. People who work in AI is more agile. They learn new things all the time. People working in data however tend to move at glacier pace. Still SQL, still database, still SSIS, just like 10 years ago. That's not how things work in our industry. If you don't completely change your skills every 5 years, you'll be out of your job.

So try the new techs. You, yes you, get to pick the tech. That's a good thing right? What more do you want? It's free, and you get the choose what you like. If you work in data, as a developer, and you can't code in Python yet, that must be the number one thing on your list. Today is the day of AI, and every company in every sector is building AI apps, in ... guess what? Yup, in Python. Checkout these 3 sites where you can learn Python for free: learnpython.org, python.land/python-tutorial, developers.google.com/edu/python.

If you are an architect, and you know almost nothing about things in AWS or Azure, you need to familiar yourself with them pronto. For Azure at least ADF, Fabric, ADLS, ADO, VM, Cosmos, API. And for AWS: S3, Glue, RDS, EC2, Lambda, Redshift, Aurora. There are literally hundreds of services in these platforms, which would take months to get your hands into. So no one can do that. You need to limit yourself to the top three. Then get the top three on the other cloud platform: AWS, Azure, and Google Cloud too.

If you are a data consultant, and you know next to nothing about Snowflake, Databricks, Matillion, Fivetran, Collibra, Ataccama, CrowdStrike, then you need to set aside one weekend asap to check them out. Or in between your meetings with clients. Consultants are worth of what they know. So if your knowledge about technologies is 5 years old, you desperately need to update yourself. And the best way to learn is by doing not by reading. Try them out. Go to their websites and then click that big green button that says "Try for free". Find out their architecture (hopefully SaaS), their data security, data governance, and how to use them. Yes, data security. If you work in data and only focusing on data loading or data governance, that's not on! You also need to know about data security. Authentication, threat detection, cyber attack and data breach. That's why I mentioned CrowdStrike. And guess what? They have free trial too! So what are you waiting for? Stop reading this and get stuck in with the new techs. Remember: you get to pick what you like, and you can try them all for free...

Keep learning!

Wojciech Jakubowski

Software & Cloud Architect at TietoEvry

11 个月

You absolutely don't need too keep track of all this tech. Not only its impossible, but it also doesn't make any sense. Most of them will be irrelevant in 3-5 years anyways. Instead I'd just pick and master 1 or 2 of them - the rest will be similar, concepts would be similar and it will be relatively easy to pick up if ever needed (which is highly doubtful).

Dipanjan S.

Engineering @ Honeywell | Senior Data Engineer | Product Development

11 个月

But still ?? I'll strongly suggest to build (do not connect using a connection string and point to the cloud ?? vendor) in local machine ?? | Once the trying out is done ?

Shaun Ryan

Data Eng??DeltaLake??Databricks??AI & BI?? - Views are mine

11 个月

Snowflake used to have a “contact us” to try it. Then cold called me every week. Super annoying. I guess they’ve changed that now?

John Ulvoy

Available +31 (0)6 4387 3552 | ETRM | Snowflake | Data Vault 2.0 | AWS | Timeseries | BI | SQL Nerd | Snowpark | Python | UDTF | API | Pandas | Freelancer | S3 | Athena | Streamlit | Hybrid or Remote

11 个月

Not just that. Try for free and demo in an interview and the job is yours

Thomas Ivarsson

Senior Business Intelligence Consultant with focus on the MS BI platform. Fully booked until May 2025.

11 个月

The easy part is to use Snowflake instead of SQL Server since the SQL is almost the same. To use Matillion instead of Data Factory was not that big step either. The problem is to add another report and visual tool instead of Power BI. I think that Power BI is too big with many existing features and new coming all the time. You also need to be good in DAX. You also have to know the Power BI service features.

要查看或添加评论,请登录

Vincent Rainardi的更多文章

  • DQ Engineering

    DQ Engineering

    DQ stands for Data Quality. If you don't have a background in data quality, read this first: https://www.

    6 条评论
  • Data Product

    Data Product

    For those of you who don't know what a data product and “data as a product” are, please read this first:…

    13 条评论
  • Snowflake vs SQL Server

    Snowflake vs SQL Server

    Sometimes we need to remind ourselves that Snowflake is not an OLTP database. I know today is the era of Hybrid tables…

    6 条评论
  • Data engineer becoming solution architect

    Data engineer becoming solution architect

    Are you a data engineer thinking about transitioning to a cloud solution architect? Data engineer are good with…

    2 条评论
  • Asset Mgt vs Fund Mgt vs Investment Mgt vs Wealth Mgt: What's the difference?

    Asset Mgt vs Fund Mgt vs Investment Mgt vs Wealth Mgt: What's the difference?

    If you work in banking or investment or any other sector in financial services, you might be wondering about the above.…

  • Data Warehousing Basics: Cost

    Data Warehousing Basics: Cost

    If you call yourself a data engineer you need to be aware of 2 additional things compared to a developer. The first one…

    2 条评论
  • My Linkedin post & articles

    My Linkedin post & articles

    The list below goes back to Nov 2024. For older than that see here.

    9 条评论
  • Data Warehousing Basics: Single Customer View

    Data Warehousing Basics: Single Customer View

    Imagine that you work for an insurance company who sell health insurance (HI), life insurance (LI), general insurance…

    2 条评论
  • Data Warehousing Basics: NFR

    Data Warehousing Basics: NFR

    What I’m about to tell you today failed a lot of data warehousing projects which is why it’s worth paying attention so…

    1 条评论
  • ML and AI - What's the difference?

    ML and AI - What's the difference?

    Machine Learning covers about 20-30 algorithms such as Logistic Regression, Decision Tree, Gradient Boosting, Random…

    4 条评论

社区洞察

其他会员也浏览了