Разработка • BuzzFeed Tech • 14 мая 2024 г. 15:29
IntroductionI would venture a guess that every analyst has at some point in their career received the task of creating a weekly, monthly, or quarterly recurring report that summarizes performance. These reports tend to have very similar topline summa...... читать далее
python google-sheets sql analytics chatgptРазработка • dev.to • 13 мая 2024 г. 11:43
Comparing AWS (Amazon Web Services) and GCP (Google Cloud Platform) involves evaluating various factors such as services, features, pricing, performance, and ease of use. Both AWS and GCP are leading cloud service providers offering a comprehensive s...... читать далее
cloud aws gcp javascriptРазработка • dev.to • 3 мая 2024 г. 18:34
In my day to day work one of the most common use cases for Apache Airflow is to run hundreds of scheduled BigQuery SQL scripts. Developers who start with Airflow often ask the following questions How to use airflow to orchestrate sql? This post ai...... читать далее
airflow bigquery dataengineering sqlРазработка • dev.to • 27 апреля 2024 г. 14:01
This blog post will discuss the benefits of integrating Google BigQuery, a leading data warehouse solution, with DuckDB, an embedded analytical database. This powerful combination can enhance your data analysis processes by offering the best of both...... читать далее
bigquery googlecloud duckdb analyticsРазработка • dev.to • 27 апреля 2024 г. 2:31
Weihao and I have been working on programmatic benchmarks for DeepCell on Google Batch. We tried Vertex AI custom training jobs but ran into an issue with service accounts. It appears that the training job ran on the expected(?) service account, but...... читать далее
cloud googlecloud gpu aiРазработка • dev.to • 16 апреля 2024 г. 20:26
If you work with Google Cloud for your Data Platform there are chances that you use BigQuery and run your Data pipelines transformations in a ELT manner: using BQ query engine to run transformations as a series of SELECT statements, one after another...... читать далее
dataops bigquery googlecloud dataРазработка • dev.to • 16 апреля 2024 г. 14:13
The world of public cloud platforms buzzes with comparisons, constantly ranking giants like AWS, Azure, and GCP in a race for “best in show.” However, when it comes to cloud security, the reality is far more nuanced. Each platform offers a unique to...... читать далее
aws azure googlecloud cloudРазработка • dev.to • 11 апреля 2024 г. 11:07
Introduction Generative AI is a growing field of artificial intelligence where large language models (LLM) are pre-trained on large amounts of data to generate text, images, video, or voice data. Sometimes, models may not need to rely solely on...... читать далее
webdev opensource openai productivityРазработка • Блог компании ISsoft • 4 апреля 2024 г. 13:40
В 2024 году аналитика данных стоит за каждым важным прогрессивным движением или новаторским шагом вперед. Начиная с такой простой вещи, как утренний кофе: Аналитика местоположения, основанная на современных инструментах анализа данных, позволила Star...... читать далее
Блог компании ТехнологииБезопасность • DZone Security • 8 марта 2024 г. 16:00
The modern data stack represents the evolution of data management, shifting from traditional, monolithic systems to agile, cloud-based architectures. It's designed to handle large amounts of data, providing scalability, flexibility, and real-time pro...... читать далее
Разработка • dev.to • 1 марта 2024 г. 20:05
Ever experienced a delayed dashboard? Been frustrated by late data for that critical report? That's the sting of stale data. As a data or analytics engineer, you know how crucial it is to have timely, up-to-date data at your fingertips. In this post...... читать далее
freshness bigquery sql tutorialРазработка • dev.to • 27 февраля 2024 г. 9:45
One of the first issues companies run into when it comes to analyzing their data is having to move the data off of their production databases: The production instances have different abilities that are not suitable for analytical workloads, such as...... читать далее
data dataengineering beginners programmingРазработка • dev.to • 24 февраля 2024 г. 3:51
In this video we learned how to test and document dbt models. We also learned about the codegen library. This is part of Week 4 of the data engineering zoomcamp by DataTalksClub. We want to identify errors quickly, and we don't want to build on top...... читать далее
dbt testing dataengineeringРазработка • dev.to • 24 февраля 2024 г. 3:44
For Week 4 of DataTalksClub's data engineering zoomcamp, we had to install dbt and create a project. This was a formidable task. dbt is a data transformation tool that enables data analysts and engineers to transform data in a cloud analytics warehou...... читать далее
dbt dataengineering bigquery sqlРазработка • dev.to • 15 февраля 2024 г. 22:14
Last week we learned about dlt (data load tool) in a workshop conducted by Adrian Brudaru and hosted by Data Talks Club. dlt can extract data from APIs in a way that's scalable. It can normalize and load data, and it can do these steps incrementally...... читать далее
dataengineering dlt duckdbРазработка • dev.to • 14 февраля 2024 г. 15:17
Um belo dia, recebo um ticket que reclamava de algo: Relatório está demorando demais Contexto Estou em um projeto de um SaaS onde se coleta centenas de sinais por minuto para serem inseridos no database do BigQuery e que, eventualmente, sã...... читать далее
csharp dotnet braziliandevs performanceРазработка • dev.to • 10 февраля 2024 г. 15:17
Streaming databases vs streaming processing framework in Python, which one fits your need? To fully leverage the data is the new oil concept, companies require a special database designed to manage vast amounts of data instantly. This need has led t...... читать далее
architecture database python programmingРазработка • dev.to • 6 февраля 2024 г. 13:52
La informática en la nube se ha convertido en una parte integral de la infraestructura de TI, experimentando un crecimiento masivo recientemente. Según Gartner, el gasto de los usuarios finales en servicios en la nube pública se prevé que alcance los...... читать далее
principiantes programaciónРазработка • dev.to • 6 февраля 2024 г. 9:59
Cloud computing has become an integral part of IT infrastructure, experiencing massive growth recently. As per Gartner, end-user spending on public cloud services is forecast to reach $591.8 billion in 2024. This rapid adoption of cloud solutions h...... читать далее
cloud cloudcomputing devops cicdРазработка • dev.to • 6 февраля 2024 г. 3:13
free-for.dev Credit :- free-for.dev Developers and Open Source authors now have many services offering free tiers, but finding them all takes time to make informed decisions. This is a list of software (SaaS, PaaS, IaaS, etc.) and other offerin...... читать далее
