Разработка • dev.to • 10 апреля 2023 г. 19:45
You're invited to participate in the very first Mage Battlegrounds: Craft insights from real-time customer behavior analysis, a 24-hour virtual hackathon hosted by Shashank Mishra! This data engineering competition will take place on Saturday, April...... читать далее
dataengineering hackathon mage mageaiРазработка • dev.to • 25 марта 2023 г. 20:08
What is SQL ? SQL (Structured Query Language) is a programming language used to communicate with databases. It is used to store, retrieve, manipulate, and manage data in relational databases. SQL uses statements to perform tasks such as updating dat...... читать далее
sql data dataengineering blogРазработка • dev.to • 20 марта 2023 г. 18:23
Can a database be used as DWH? Yes, Database can be used as a Data Warehouse. Even before the data warehouse, we use database for the business. But now it's a good practice to use Data warehouse because of quick response and Analystical tools. Data...... читать далее
data dataengineering pipelines questionsРазработка • dev.to • 19 февраля 2023 г. 8:14
Python dictionaries are a powerful data structure that can be useful in many data engineering applications. In this blog, we'll explore some of the ways that you can use Python dictionaries in data engineering, including how to create and manipulate...... читать далее
dataengineering python tutorial 100daysofcodeРазработка • dev.to • 2 февраля 2023 г. 8:30
The data landscape is rapidly evolving, and the amount of data being produced and distributed on a daily basis is downright staggering. According to the report by Statista, currently, there are approximately 120 zettabytes of data in existence (as of...... читать далее
dataops data beginners dataengineeringРазработка • dev.to • 31 января 2023 г. 2:41
My background is mostly in web development, but I am learning data engineering because I am interested in business intelligence and want to level-up my knowledge. One of the things that I have recently discovered is data validation within a data pipe...... читать далее
datascience dataengineering datavalidation greatexpectationsРазработка • dev.to • 20 января 2023 г. 23:50
Every act of conscious learning requires the willingness to suffer an injury to one's self-esteem. That is why young children, before they are aware of their own self-importance, learn so easily. Thomas Szasz Motivation A Data Lakehouse...... читать далее
dataengineering datascience python databaseРазработка • dev.to • 11 января 2023 г. 17:06
Note: this article is also available in portuguese 🌎. A landmark in Gothic literature, the iconic novel Dracula, written by Bram Stoker in 1897, stirs the emotions of people across the world. Today, to introduce Spark's new concepts and features,...... читать далее
python dataengineering spark datascienceРазработка • dev.to • 9 ноября 2022 г. 18:27
TLDR Data integration is synchronizing information between 1 system (e.g. Salesforce) and another (e.g. Snowflake) Source: Giphy Outline What is it? Why do you need it? How do you implement it? Who is it for? Future and next steps...... читать далее
dataintegration datapipelines datascience dataengineeringРазработка • dev.to • 2 ноября 2022 г. 14:07
Data growth was a direct result of the popularity of the world wide web. Increased traffic on websites and web-based applications were also some of the factors. Web data collection began as an instrument for debugging web applications by analyzing lo...... читать далее
etl dataengineering datapipelines eltРазработка • dev.to • 10 октября 2022 г. 11:06
Start by trying to understand the fundamentals, what data engineering is, some of the common task that data engineer performs at different companies, common data terminology and learn how to define your problems before you tackle them. Work with SQL...... читать далее
python datascience dataengineering machinelearningРазработка • dev.to • 24 сентября 2022 г. 16:24
Considerado como um marco da literatura gótica, o icônico livro Drácula, escrito em 1897 por Bram Stoker, desperta até hoje o fascínio das pessoas por todo o mundo. Hoje, a fim de introduzir novos conceitos e funcionalidades do Apache Spark, vamos de...... читать далее
pyspark python dataanalysis dataengineeringРазработка • dev.to • 27 августа 2022 г. 13:31
As a data engineer, I can’t imagine doing my job without Python. In this article, I’d like to share my thoughts on how Python makes my work easier and, in some cases, possible at all. Python is one of the most popular programming languages worldwide...... читать далее
dataengineering dsea python bigdataРазработка • dev.to • 24 августа 2022 г. 14:50
When you hear about data engineering what comes in your mind? According to me its basically the act of coming up with systems to facilitate the gathering and making use data. The data collected is used to enable subsequent analysis and data science w...... читать далее
codenewbie dataengineering beginners programmingРазработка • habr.com • 28 июля 2022 г. 2:06
От мейнфреймов до ПК, до смартфонов, до облаков и так далее. Генеральный директор Robusta.dev Натан Йеллен говорит о Kubernetes и будущем облачных вычислений. Узнайте, почему Kubernetes — это больше, чем просто платформа для оркестрации контейнеров,...... читать далее
DevOps Kubernetes Облачные вычисления k8s операционные системы платформа как услуга кластеры контейнеризация свободное программное обеспечение облачные платформы облачные провайдерыРазработка • dev.to • 26 ноября 2021 г. 13:09
Shutting down gracefully is important for any long lasting process, especially for one that handles some kind of state. For example, what if you wanted to shutdown the database that supports your application and the db process didn't flush the curren...... читать далее
go dataengineering sre databaseРазработка • dev.to • 25 ноября 2021 г. 10:50
I started Blendo in 2014. The only knowledge I had at that time was that I wanted to leave academia and consulting to build a company and, most importantly, a product. I also knew that, based on my background, whatever I would be building would be so...... читать далее
blendo dataengineering etl cdpРазработка • dev.to • 25 ноября 2021 г. 10:47
Thank you Yakko Majuri from PostHog for coming up with the idea for this article and for your feedback and contributions to it. A data analytics stack enables all of the teams across your organization to look at important metrics and make data-drive...... читать далее
privacy analytics dataanalytics dataengineeringРазработка • dev.to • 24 ноября 2021 г. 17:32
I started my second career as a Nuclear Fuel Uranium trader around a decade ago. A few years in, I was frustrated with my company's refusal to upgrade systems beyond 7 spreadsheets with redundant information scattered throughout, so I started my jour...... читать далее
python beautifulsoup dataengineeringРазработка • dev.to • 24 ноября 2021 г. 6:39
Software licensing can be a tricky subject, especially when you are a commercial company building an open-source product like RudderStack. We want to build RudderStack into a strong company, and we keep some of our features under our enterprise lice...... читать далее
cdp dataengineering rudderstack privacy
