Try new tech
As someone who works in data, you need to keep track of the technologies. Things like Snowflake, Databricks, BigQuery, Fabric, Qlik, S3, ADF, Fivetran, Matillion, Dataiku, Collibra, etc. Sometimes I heard people said "I don't have access". That is no excuse. You can try almost any technology for free. All vendors are competing for our attention. Whether you are a developer, an analyst, an architect or a consultant, all technology providers want you to know them. Whether they work in databases, data integration or data management, they all want you to try their products. All you need to do is go to their websites, like Snowflake.com, Databricks.com, Qlik.com, Dataiku.com, Tableau.com and click on Try for Free. They all have free trial.
Be careful when you want to try out Looker (it's like Power BI and Tableau, from Google). You need to disable the API otherwise you could be charged with thousands of dollars. If this happens contact their customer service asap and they will be able to reverse that charge out.
There is no excuse for not trying out new technologies. We are not in electrical engineering, nor construction industry, where the technologies move at glacier pace. We are in the information technology, where things move so quickly that you if blink you'll miss it. People who work in AI is more agile. They learn new things all the time. People working in data however tend to move at glacier pace. Still SQL, still database, still SSIS, just like 10 years ago. That's not how things work in our industry. If you don't completely change your skills every 5 years, you'll be out of your job.
So try the new techs. You, yes you, get to pick the tech. That's a good thing right? What more do you want? It's free, and you get the choose what you like. If you work in data, as a developer, and you can't code in Python yet, that must be the number one thing on your list. Today is the day of AI, and every company in every sector is building AI apps, in ... guess what? Yup, in Python. Checkout these 3 sites where you can learn Python for free: learnpython.org, python.land/python-tutorial, developers.google.com/edu/python.
领英推荐
If you are an architect, and you know almost nothing about things in AWS or Azure, you need to familiar yourself with them pronto. For Azure at least ADF, Fabric, ADLS, ADO, VM, Cosmos, API. And for AWS: S3, Glue, RDS, EC2, Lambda, Redshift, Aurora. There are literally hundreds of services in these platforms, which would take months to get your hands into. So no one can do that. You need to limit yourself to the top three. Then get the top three on the other cloud platform: AWS, Azure, and Google Cloud too.
If you are a data consultant, and you know next to nothing about Snowflake, Databricks, Matillion, Fivetran, Collibra, Ataccama, CrowdStrike, then you need to set aside one weekend asap to check them out. Or in between your meetings with clients. Consultants are worth of what they know. So if your knowledge about technologies is 5 years old, you desperately need to update yourself. And the best way to learn is by doing not by reading. Try them out. Go to their websites and then click that big green button that says "Try for free". Find out their architecture (hopefully SaaS), their data security, data governance, and how to use them. Yes, data security. If you work in data and only focusing on data loading or data governance, that's not on! You also need to know about data security. Authentication, threat detection, cyber attack and data breach. That's why I mentioned CrowdStrike. And guess what? They have free trial too! So what are you waiting for? Stop reading this and get stuck in with the new techs. Remember: you get to pick what you like, and you can try them all for free...
Keep learning!
Software & Cloud Architect at TietoEvry
11 个月You absolutely don't need too keep track of all this tech. Not only its impossible, but it also doesn't make any sense. Most of them will be irrelevant in 3-5 years anyways. Instead I'd just pick and master 1 or 2 of them - the rest will be similar, concepts would be similar and it will be relatively easy to pick up if ever needed (which is highly doubtful).
Engineering @ Honeywell | Senior Data Engineer | Product Development
11 个月But still ?? I'll strongly suggest to build (do not connect using a connection string and point to the cloud ?? vendor) in local machine ?? | Once the trying out is done ?
Data Eng??DeltaLake??Databricks??AI & BI?? - Views are mine
11 个月Snowflake used to have a “contact us” to try it. Then cold called me every week. Super annoying. I guess they’ve changed that now?
Available +31 (0)6 4387 3552 | ETRM | Snowflake | Data Vault 2.0 | AWS | Timeseries | BI | SQL Nerd | Snowpark | Python | UDTF | API | Pandas | Freelancer | S3 | Athena | Streamlit | Hybrid or Remote
11 个月Not just that. Try for free and demo in an interview and the job is yours
Senior Business Intelligence Consultant with focus on the MS BI platform. Fully booked until May 2025.
11 个月The easy part is to use Snowflake instead of SQL Server since the SQL is almost the same. To use Matillion instead of Data Factory was not that big step either. The problem is to add another report and visual tool instead of Power BI. I think that Power BI is too big with many existing features and new coming all the time. You also need to be good in DAX. You also have to know the Power BI service features.