Mission Control for Your Data Pipelines

Joined March 2021
203 Photos and videos
27 Feb 2024
๐–๐ž'๐ซ๐ž ๐ž๐ฑ๐œ๐ข๐ญ๐ž๐ ๐ญ๐จ ๐ฎ๐ง๐ฏ๐ž๐ข๐ฅ "๐๐ฒ๐ญ๐ก๐จ๐ง ๐ˆ๐ง๐ ๐ž๐ฌ๐ญโ€, ๐จ๐ฎ๐ซ ๐ฅ๐š๐ญ๐ž๐ฌ๐ญ ๐ข๐ง๐ง๐จ๐ฏ๐š๐ญ๐ข๐จ๐ง ๐๐ž๐ฌ๐ข๐ ๐ง๐ž๐ ๐ญ๐จ ๐ž๐ง๐ก๐š๐ง๐œ๐ž ๐๐š๐ญ๐š ๐ข๐ง๐ ๐ž๐ฌ๐ญ๐ข๐จ๐ง ๐ฉ๐ซ๐จ๐œ๐ž๐ฌ๐ฌ๐ž๐ฌ. With Python Ingest, you can: ๐Ÿš€ implement custom ingestion logic, ๐Ÿš€ remove boilerplate code to load data into your data warehouse, and ๐Ÿš€ get standardized metadata, lineage, and documentation out of the box. Read on in our announcement post: y42.com/blog/announcing-pythโ€ฆ

2
1
2
466
18 Jan 2024
As we embrace the challenges and opportunities of 2024, it's crucial to stay ahead in the data world. We sat together with Madison Schott to discuss key industry trends and make 5 data predictions for 2024. ๐Ÿ”ฎ Read on in our blog post: y42.com/blog/5-data-predictiโ€ฆ
1
432
28 Nov 2023
Sharing some best practices for working with dbt and BigQuery. Hands-on insights from a data practitioner. Discussing relevant BigQuery functions, table partitioning, and materialization strategies. Check it out: y42.com/blog/dbt-bigquery-beโ€ฆ
228
8 Aug 2023
Calling all data enthusiasts! ๐Ÿง‘โ€๐Ÿ’ป Say hello to Virtual Data Builds by Y42! Unify logical changes via Git, materialize code changes, and handle operational changes in a single structure - environment management for Data simplified! ๐Ÿ’œ Detailed announcement in the comments.
1
220
31 May 2023
Data teams keep making the same mistakes over and over again. Why is that? ๐Ÿค” Hereโ€™s our guess: โŒ Lack of reflection and learning โŒ Ineffective collaboration โŒ Inadequate documentation โŒ Failure to adapt to change Learn more here: y42.com/blog/data-team-challโ€ฆ
215
29 Mar 2023
#Readoftheweek ๐Ÿค“๐Ÿ‘‡๐Ÿผ Poor data quality undermines all the time and effort you put into your work. โŒ Your systems don't matter โŒ How robust your pipelines are doesn't matter Learn more about the importance of #dataquality for #dataengineers here: y42.com/blog/data-quality-foโ€ฆ
1
230
20 Mar 2023
Want to improve your company's #datagovernance program this year? ๐Ÿ‘‰๐Ÿผ Check out our #readoftheweek to learn how you can implement data governance best practices into your day-to-day work: y42.com/blog/data-governanceโ€ฆ

157
17 Mar 2023
Thank you to everyone who joined our #webinar with @redsift and @googlecloud on the benefits of automating your data pipelines. ๐Ÿ‘‰๐Ÿผ If you missed out on the webinar, you can watch the recording here: y42.com/event/data-operationโ€ฆ

1
135
15 Mar 2023
Part of a data team's responsibility is improving a company's overall #dataliteracy. Start sharing #datacontent with business users, beginner data analysts, or anyone in between. Here's our pick for their perfect #readoftheweek: y42.com/blog/data-pipeline/?โ€ฆ
96
8 Mar 2023
Have we already mentioned that we have a #webinar coming up? ๐Ÿ‘€ โœ… Learn how to manage increasing data needs and requests. โœ… Learn how to automate your data infrastructure as your company grows. ๐Ÿ‘‰๐Ÿผ Sign up here:ย y42.com/event/event-page-redโ€ฆ
2
133
3 Mar 2023
Looking for an insightful read to wrap up the week? ๐Ÿค“ How about discovering the power of #Git workflows and branching strategies to #versioncontrol your #dataproducts? Check out our recommended #readoftheweek here: ๐Ÿ‘‡๐Ÿผ y42.com/blog/version-controlโ€ฆ
1
78
2 Mar 2023
Discover the power of automated #datapipelines! Join Eliott Sacau (@redsift ), Jelena Mijuskovic (@Google ) and Ba Khai Tran (@y42dotcom ) in our upcoming #webinar! ๐Ÿ‘‰๐Ÿผ Sign up here: lnkd.in/eXMaE5Nx
1
126
27 Feb 2023
Hereโ€™s a step-by-step guide on how to build production-ready #datapipelines.ย ๐Ÿ‘‡๐Ÿผ
1
1
662
10 Feb 2023
Here are 3 steps to follow if you want to implement #dataownership within your organization.๐Ÿ‘‡๐Ÿผ 1๏ธโƒฃ Get an overview of all your data assets by making an inventory 2๏ธโƒฃ Determine domain experts per data asset 3๏ธโƒฃ Implement a data catalog for better traceability
1
152
6 Feb 2023
๐Ÿ‘‡๐Ÿผ This is what you need to do to avoid not knowing when a data model failed. ๐Ÿ‘‡๐Ÿผ Test intermediate and core models too! ๐Ÿ’ก If you don't, you let errors pass onto your final model and have to check all previous models to identify the culprit. ๐Ÿซ  #datatesting #datamodeling
1
1
554
1 Feb 2023
Types of #datagovernance frameworks: โœ… Command and control framework โœ… Traditional frameworkย  โœ… Non-invasive frameworkย  Which one should you choose? That will depend on your company goals and team structure.
117
30 Jan 2023
Here are the 6 key benefits of #datamonitoring.๐Ÿ‘‡๐Ÿผ 1๏ธโƒฃ Faster debugging and minimized inconsistencies 2๏ธโƒฃ Increased business efficiency 3๏ธโƒฃ Stable and standardized data pipeline 4๏ธโƒฃ Faster retrieval of actionable data 5๏ธโƒฃ Reduced data preparation time 6๏ธโƒฃ Cost-effectiveness
111