https://julianamarialop.github.io/en/tags/azure/Recent content in Azure on Ahead of the AIHugoen-USFri, 21 Aug 2026 14:00:00 +0000https://julianamarialop.github.io/en/articles/pawn-rook-queen-how-to-field-the-right-model-for-each-agent/Fri, 21 Aug 2026 14:00:00 +0000https://julianamarialop.github.io/en/articles/pawn-rook-queen-how-to-field-the-right-model-for-each-agent/Every chess player learns a table early on and carries it for life: a pawn is worth 1, knight and bishop are worth 3, a rook is worth 5, the queen is worth 9. It isn’t a rule of the game, it’s centuries of accumulated wisdom about the relative power of each…https://julianamarialop.github.io/en/articles/leap-of-faith-data-engineer-to-ai-engineer-in-90-days-microsoft/Fri, 20 Feb 2026 13:40:00 +0000https://julianamarialop.github.io/en/articles/leap-of-faith-data-engineer-to-ai-engineer-in-90-days-microsoft/In the Assassin’s Creed universe, the Leap of Faith is an act of courage, technique and trust. It isn’t a blind jump, but a calculated move that demands knowledge of the terrain and precision to reach a new level. In the…https://julianamarialop.github.io/en/articles/microsoft-foundry-the-film-studio-of-the-new-era-of-ai/Thu, 19 Feb 2026 01:29:00 +0000https://julianamarialop.github.io/en/articles/microsoft-foundry-the-film-studio-of-the-new-era-of-ai/Picture Microsoft Foundry as a big film studio dedicated to producing AI movies. Instead of projectors, cameras, and scripts, it offers tools, models, and infrastructure to turn ideas into…https://julianamarialop.github.io/en/articles/ai-data-engineer-the-evolution-of-the-data-engineer-in-the-age-of-intelligent-agents/Wed, 07 Jan 2026 14:21:00 +0000https://julianamarialop.github.io/en/articles/ai-data-engineer-the-evolution-of-the-data-engineer-in-the-age-of-intelligent-agents/The data engineering profession is going through its biggest transformation since the move to the cloud. For years, the focus was on building efficient pipelines, moving data from one point to another and making sure…https://julianamarialop.github.io/en/articles/microsoft-fabric-at-ignite-2025-the-complete-guide-to-whats-new/Tue, 25 Nov 2025 15:53:00 +0000https://julianamarialop.github.io/en/articles/microsoft-fabric-at-ignite-2025-the-complete-guide-to-whats-new/Microsoft Ignite 2025 wasn’t an event about future promises; it was about concrete deliveries that mark the maturity of Microsoft Fabric. The platform stopped being a collection of promising tools and became…https://julianamarialop.github.io/en/articles/microsoft-agent-framework-becoming-an-ai-pokemon-master/Fri, 03 Oct 2025 18:43:00 +0000https://julianamarialop.github.io/en/articles/microsoft-agent-framework-becoming-an-ai-pokemon-master/Imagine you’re a Pokémon trainer, but instead of catching Pikachus and Charizards, you’re building a team of specialized AI agents. Each agent has its own unique abilities, can learn…https://julianamarialop.github.io/en/articles/azure-ai-search-your-corporate-digital-british-library/Fri, 19 Sep 2025 14:24:00 +0000https://julianamarialop.github.io/en/articles/azure-ai-search-your-corporate-digital-british-library/Imagine having access to the British Library (the largest library in the world, with more than 200 million items) but dedicated exclusively to your company’s documents. Now imagine that this library has a librarian…https://julianamarialop.github.io/en/articles/la-traviata-of-data-how-fabric-failed-to-win-the-market/Mon, 25 Aug 2025 14:21:00 +0000https://julianamarialop.github.io/en/articles/la-traviata-of-data-how-fabric-failed-to-win-the-market/In May 2023, Microsoft announced Microsoft Fabric as a revolutionary solution to unify every analytical workload on a single platform. The promise was ambitious: lakehouse, data warehouse…https://julianamarialop.github.io/en/articles/databricks-one-the-superman-of-data-democratizes-information/Thu, 14 Aug 2025 13:06:00 +0000https://julianamarialop.github.io/en/articles/databricks-one-the-superman-of-data-democratizes-information/Just as Clark Kent had to turn into Superman so ordinary people could be saved, the data world has always required business users to turn into “super-techies” to access…https://julianamarialop.github.io/en/articles/grandma-hr-apple-pie-resume-screening-agent-azure-ai-foundry/Fri, 18 Jul 2025 18:11:00 +0000https://julianamarialop.github.io/en/articles/grandma-hr-apple-pie-resume-screening-agent-azure-ai-foundry/Remember your grandma’s apple pie? That special recipe that took hours to make, but always came out perfect? The modern Human Resources department faces a similar dilemma: how to keep the…https://julianamarialop.github.io/en/articles/fabric-hero-complete-arsenal-new-powers-and-gear-july-2025/Wed, 16 Jul 2025 14:19:00 +0000https://julianamarialop.github.io/en/articles/fabric-hero-complete-arsenal-new-powers-and-gear-july-2025/July 2025 arrived with a shower of updates that turned Microsoft Fabric into an even more powerful superhero. Like any self-respecting hero, Fabric never stops evolving, picking up new powers and…https://julianamarialop.github.io/en/articles/perfect-blueprint-for-analytics-on-azure-well-architected-review/Fri, 06 Jun 2025 15:58:00 +0000https://julianamarialop.github.io/en/articles/perfect-blueprint-for-analytics-on-azure-well-architected-review/In today’s world, where data is the new oil (or maybe the new bricks?), building robust, efficient Analytics solutions on Azure has become a complex engineering task. Platforms like Microsoft Fabric…https://julianamarialop.github.io/en/articles/back-to-the-future-of-pipelines-azure-data-factory-databricks-jobs/Mon, 19 May 2025 17:54:00 +0000https://julianamarialop.github.io/en/articles/back-to-the-future-of-pipelines-azure-data-factory-databricks-jobs/For years, data engineers have been building pipelines that connect Azure Data Factory (ADF) to Databricks, a powerful combination that often required manual tweaks and complex configuration. It was like…https://julianamarialop.github.io/en/articles/the-expanding-databricks-universe-new-constellations-of-may-2025/Mon, 19 May 2025 16:58:00 +0000https://julianamarialop.github.io/en/articles/the-expanding-databricks-universe-new-constellations-of-may-2025/The Databricks universe is constantly expanding. Like a living, pulsing galaxy, every month brings new “constellations” of features, integrations, and acquisitions that light the way for data professionals and…https://julianamarialop.github.io/en/articles/azure-databricks-sql-pipe-syntax-master-query-elements-like-avatar/Fri, 09 May 2025 14:15:00 +0000https://julianamarialop.github.io/en/articles/azure-databricks-sql-pipe-syntax-master-query-elements-like-avatar/Anyone who works with SQL knows that, powerful as the language is, writing and understanding complex queries, especially those with multiple nested subqueries, can be a challenge. We often feel…https://julianamarialop.github.io/en/articles/monsters-inc-no-more-ingestion-scares-databricks-lakeflow-connect/Mon, 05 May 2025 13:16:00 +0000https://julianamarialop.github.io/en/articles/monsters-inc-no-more-ingestion-scares-databricks-lakeflow-connect/Any Monsters, Inc. fans out there? Remember how the whole factory depended on the energy from children’s screams (and later their laughter!) to keep Monstropolis running? In our data universe, we could say that…https://julianamarialop.github.io/en/articles/azure-databricks-delta-sharing-and-the-data-buffet/Thu, 06 Feb 2025 15:11:00 +0000https://julianamarialop.github.io/en/articles/azure-databricks-delta-sharing-and-the-data-buffet/Imagine a world where sharing data between companies is as simple as opening a delivery app and ordering your favorite meal. Instead of complicated processes, slow transfers, and worries…https://julianamarialop.github.io/en/articles/egyptian-gods-and-ai-build-an-llm-on-azure-databricks-rag-fine-tuning-mosaicml/Fri, 31 Jan 2025 14:29:00 +0000https://julianamarialop.github.io/en/articles/egyptian-gods-and-ai-build-an-llm-on-azure-databricks-rag-fine-tuning-mosaicml/If the ancient Egyptians could build an artificial intelligence, they would probably call on their gods to make the system wiser, faster and more efficient. Just as Ra lit up the world, Thoth recorded…https://julianamarialop.github.io/en/articles/azure-databricks-dqx-the-doctor-strange-of-your-data-pipeline/Mon, 20 Jan 2025 13:45:00 +0000https://julianamarialop.github.io/en/articles/azure-databricks-dqx-the-doctor-strange-of-your-data-pipeline/These days, data-driven decision-making is at the heart of every company. However, the effectiveness of those decisions depends directly on the quality of the data used. Inconsistent, incomplete, or…https://julianamarialop.github.io/en/articles/like-a-well-organized-beehive-exploring-azure-databricks-clusters/Wed, 15 Jan 2025 13:45:00 +0000https://julianamarialop.github.io/en/articles/like-a-well-organized-beehive-exploring-azure-databricks-clusters/Databricks is a robust platform for processing and analyzing large volumes of data, supporting workloads that range from data engineering to data science and business analytics. One of the…https://julianamarialop.github.io/en/articles/azure-databricks-and-watsonx-data-in-the-heroes-arena/Mon, 13 Jan 2025 13:30:00 +0000https://julianamarialop.github.io/en/articles/azure-databricks-and-watsonx-data-in-the-heroes-arena/In recent years, the need for robust platforms to analyze large volumes of data has become clear for companies looking to become more data-driven. Two of the most talked-about solutions…https://julianamarialop.github.io/en/articles/modernize-cobol-processes-azure-databricks-pave-recipe-jcl-vsam/Fri, 10 Jan 2025 19:12:00 +0000https://julianamarialop.github.io/en/articles/modernize-cobol-processes-azure-databricks-pave-recipe-jcl-vsam/After writing my previous article on migrating from SAS to Databricks as a cake recipe, I enjoyed the experience so much that I decided to repeat the idea, but this time with COBOL! Since COBOL is a language…https://julianamarialop.github.io/en/articles/how-to-migrate-from-sas-to-azure-databricks-a-foolproof-two-step-recipe/Thu, 09 Jan 2025 13:17:00 +0000https://julianamarialop.github.io/en/articles/how-to-migrate-from-sas-to-azure-databricks-a-foolproof-two-step-recipe/Migrating a well-established platform like SAS to Databricks can be challenging, but when we follow a well-structured recipe, everything becomes simpler and more efficient. In this recipe, we’ll split the process into…https://julianamarialop.github.io/en/articles/turn-your-pipelines-into-superheroes-5-villains-azure-databricks/Thu, 09 Jan 2025 00:13:00 +0000https://julianamarialop.github.io/en/articles/turn-your-pipelines-into-superheroes-5-villains-azure-databricks/How about comparing the mistakes that sabotage your data pipelines to the villains who keep getting in the way of the superheroes’ mission? Picture your pipeline as the hero of the story, tasked with carrying the data to its final destination…https://julianamarialop.github.io/en/articles/rub-the-lamp-and-get-insights-a-guide-to-ai-bi-genie-on-azure-databricks/Mon, 21 Oct 2024 15:47:00 +0000https://julianamarialop.github.io/en/articles/rub-the-lamp-and-get-insights-a-guide-to-ai-bi-genie-on-azure-databricks/Imagine being able to talk to your data as if you were chatting with a coworker or, better yet, as if you were dealing with the genie of a magic lamp. That’s exactly what AI/BI Genie makes possible!…https://julianamarialop.github.io/en/articles/from-zero-to-bronze-build-a-notebook-without-coding-databricks-assistant/Wed, 09 Oct 2024 21:31:00 +0000https://julianamarialop.github.io/en/articles/from-zero-to-bronze-build-a-notebook-without-coding-databricks-assistant/In the data world, building a bronze layer, which organizes raw data into an accessible structure for later transformations, has traditionally involved a lot of coding. Recently, however, I explored a…https://julianamarialop.github.io/en/articles/may-the-analytical-force-be-with-you-exploring-databricks-star-wars-style/Mon, 23 Sep 2024 15:56:00 +0000https://julianamarialop.github.io/en/articles/may-the-analytical-force-be-with-you-exploring-databricks-star-wars-style/In recent years, Databricks has established itself as a powerful platform, much like the Force that guides the Jedi on their missions, helping companies accelerate their data and analytics projects. Just as the union between the…https://julianamarialop.github.io/en/articles/data-analytics-on-scorched-earth-the-decline-of-azure-synapse/Fri, 26 Jul 2024 22:23:00 +0000https://julianamarialop.github.io/en/articles/data-analytics-on-scorched-earth-the-decline-of-azure-synapse/Azure Synapse is Microsoft’s Data Warehouse solution on the Azure cloud. However, it has been facing internal competition from Databricks for some time and, since last year, from Microsoft Fabric as well.https://julianamarialop.github.io/en/articles/microsoft-fabric-pause-resume-scale-capacity-with-data-factory-pipeline/Mon, 15 Jul 2024 14:30:00 +0000https://julianamarialop.github.io/en/articles/microsoft-fabric-pause-resume-scale-capacity-with-data-factory-pipeline/There are several ways to pause, resume, or scale a Microsoft Fabric Capacity. Note that this applies only to F-SKUs in Azure, since Premium Capacity (P-SKU) can only be scaled.https://julianamarialop.github.io/en/articles/exploring-new-horizons-transform-your-organization-data-mesh-fabric/Fri, 12 Jul 2024 13:16:00 +0000https://julianamarialop.github.io/en/articles/exploring-new-horizons-transform-your-organization-data-mesh-fabric/Microsoft Fabric is the complete solution for all of your company’s analytics needs, unifying the whole process in a single platform. From ingesting data into the data lake to delivering information to…https://julianamarialop.github.io/en/articles/connected-future-unity-catalog-and-microsoft-fabric-working-together/Wed, 10 Jul 2024 13:28:00 +0000https://julianamarialop.github.io/en/articles/connected-future-unity-catalog-and-microsoft-fabric-working-together/This article reflects my personal experiences and points of view, not the official position of Microsoft or Databricks. In addition, although this post describes potential scenarios, it does not necessarily reflect the…https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-part-4-v-order/Mon, 08 Jul 2024 16:55:00 +0000https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-part-4-v-order/We’ve reached the end of the “Integrating Azure Databricks and Microsoft Fabric” series. Throughout this journey, we explored how these two powerful tools can be combined to optimize data analytics processes…https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-part-iii-onelake-gold-layer/Fri, 05 Jul 2024 17:26:00 +0000https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-part-iii-onelake-gold-layer/Disclaimer: this article reflects my personal experiences and views, not an official position of Microsoft Fabric or Databricks.https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-part-2-reporting-layer/Thu, 04 Jul 2024 14:18:00 +0000https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-part-2-reporting-layer/Disclaimer: this article reflects my personal experiences and views, not an official position of Microsoft Fabric or Databricks.https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-a-meeting-of-giants-part-1/Tue, 02 Jul 2024 20:17:00 +0000https://julianamarialop.github.io/en/articles/integrating-azure-databricks-and-microsoft-fabric-a-meeting-of-giants-part-1/Disclaimer: this article reflects my personal experiences and views, not an official position of Microsoft Fabric or Databricks.https://julianamarialop.github.io/en/articles/how-to-calculate-real-cost-azure-databricks-sql-warehouse-instances/Sat, 29 Jun 2024 22:21:00 +0000https://julianamarialop.github.io/en/articles/how-to-calculate-real-cost-azure-databricks-sql-warehouse-instances/Shall we learn how to calculate the cost of SQL Warehouse instances in Microsoft Azure Databricks the easy way? Then follow along with this article.https://julianamarialop.github.io/en/articles/best-practices-for-using-data-fabric-workspaces-with-git/Mon, 20 May 2024 16:55:00 +0000https://julianamarialop.github.io/en/articles/best-practices-for-using-data-fabric-workspaces-with-git/Effective management of data pipelines is key to ensuring continuous development, testing, and deployment processes. Integrating Git with Microsoft Fabric workspaces offers a…https://julianamarialop.github.io/en/articles/continuous-integration-and-delivery-cicd-in-azure-data-factory/Thu, 12 Oct 2023 13:00:00 +0000https://julianamarialop.github.io/en/articles/continuous-integration-and-delivery-cicd-in-azure-data-factory/CI is the practice of automatically testing every code change, while CD deploys those changes to staging or production systems. In Azure Data Factory, CI/CD involves moving pipelines between…https://julianamarialop.github.io/en/articles/azure-data-factory-and-azure-databricks-best-practices/Fri, 29 Sep 2023 13:00:00 +0000https://julianamarialop.github.io/en/articles/azure-data-factory-and-azure-databricks-best-practices/Hello everyone, this week we’ll go over some best practices for a data ingestion pipeline:https://julianamarialop.github.io/en/articles/key-differences-between-azure-synapse-and-databricks/Thu, 21 Sep 2023 15:31:00 +0000https://julianamarialop.github.io/en/articles/key-differences-between-azure-synapse-and-databricks/Hi everyone, in this article I’ll talk a bit about these data platforms.https://julianamarialop.github.io/en/articles/azure-synapse-analytics-vs-microsoft-fabric-another-migration-project/Tue, 30 May 2023 17:44:00 +0000https://julianamarialop.github.io/en/articles/azure-synapse-analytics-vs-microsoft-fabric-another-migration-project/In May 2023, Microsoft announced Microsoft Fabric. This new solution extends the integration promise made in Azure Synapse Analytics to cover every analytics workload, and it can be used…https://julianamarialop.github.io/en/articles/big-data-architecture-choose-the-right-plumbing-for-your-pipelines/Mon, 15 Jun 2020 16:40:00 +0000https://julianamarialop.github.io/en/articles/big-data-architecture-choose-the-right-plumbing-for-your-pipelines/Last week, I wrote an article about data pipelines (check it out here) covering the main characteristics of a robust and optimized build, ideally using a…https://julianamarialop.github.io/en/articles/big-data-on-premise-vs-cloud-computing-market-view-study-guide/Thu, 09 Apr 2020 14:48:00 +0000https://julianamarialop.github.io/en/articles/big-data-on-premise-vs-cloud-computing-market-view-study-guide/For some years now, companies all over the world have been tapping into the immense value Big Data can add to their business. Implementing Big Data ecosystems is a reality in both the global and the Brazilian market. With ever…https://julianamarialop.github.io/en/articles/databricks-the-swiss-army-knife-of-your-big-data-platform/Tue, 23 Apr 2019 16:07:00 +0000https://julianamarialop.github.io/en/articles/databricks-the-swiss-army-knife-of-your-big-data-platform/Imagine a team made up of a SQL developer, a Python professional and a Scala contributor. They all work together to ingest data into your Datalake, your Datawarehouse or simply…