6 days agoDremio and Modern Data Architecture: Data Lakes, Data Lakehouses and Data MeshToday it can seem like a buzzword onslaught in the data space with terms like Data Mesh, Data Lakehouse, and many more being thrown out with every vendor trying to make their claim that they provide “the answer.” However, in this article, I will discuss the underlying reality that does…Data Mesh5 min readData Mesh5 min read
May 30What is Nessie and Why as a Data Engineer or Architect you should care?We need to establish a few things to understand why the open-source data catalog, Project Nessie, matters so much. Why do Data Lakehouses Matter? The amount of data and use cases for that data are exploding faster than any single tool can develop sufficient support for. However, many tools support different use cases like BI…Data Lake3 min readData Lake3 min read
May 10Resources for Learning more about Catalog level versioning with Project Nessie & Dremio Arctic (Rollbacks, Branching, Tagging and Multi-Table Txns)Data Quality, Governance, Observability, and Disaster Recovery are issues that are still trying to discover best practices in the world of the data lakehouse. A new trend is rising, borrowing from the practices used by software developers to manage these issues with code bases. This trend is called “Data as…Data Lakehouse4 min readData Lakehouse4 min read
Apr 5Overview of the Data Lakehouse, Dremio and Apache IcebergIn this article, I hope clarify the who, what, why, and how of: The Data Lakehouse Dremio Apache Iceberg If you are looking for a more general overview of the data landscape, check out this article I wrote about the data world at a high level. The Data Lakehouse What is the Data Lakehouse? Before the concept of…Dremio6 min readDremio6 min read
Nov 22, 2022Configuring Apache Spark for Apache IcebergApache Iceberg Apache Iceberg is quickly becoming the industry standard for interfacing with data on data lakes. A lot of the time when people first try out Iceberg they do so using Apache Spark. Often to start spark up you may run a command like this: spark-sql --packages org.apache.iceberg:iceberg-spark-runtime-3.2_2.12:1.0.0\…Apache Iceberg3 min readApache Iceberg3 min read
Aug 9, 20225 Reasons Your Data Lakehouse should Embrace Dremio CloudDremio Cloud makes it easier to enjoy the performance and ease of use often associated with data warehouses. It combines that performance/ease of use with the openness and affordability associated with data lakes, the data lakehouse dream. …Dremio5 min readDremio5 min read
Jul 18, 2022Hands-On Introduction to Apache Iceberg — Data Lakehouse EngineeringAs a Developer Advocate for Dremio I spend a lot of time doing research on technology and best practices around engineering Data Lakehouses and sharing what I learn through content for Subsurface — The Data Lakehouse Community. …Data Lakehouse4 min readData Lakehouse4 min read
Jul 16, 2022Web Development Glossary 2022Abstraction: Something that simplifies the complexities of something else to make it easier to use without the need to understand how it works. Server: Application running on a network that takes request and generates a response. Often, these responses are either HTML web pages or data JSON format. Client: Application…Web Development4 min readWeb Development4 min read
Jun 20, 2022Introduction to The World of Data — (OLTP, OLAP, Data Warehouses, Data Lakes and more)In this article, I hope to paint a picture of the modern data world and when done you should have a decent understanding of the roles of Data Engineers, Data Analysts and Data Scientists and the technologies that empower them. The Transactional World (OLTP) Imagine we are creating the newest social media startup. Our…Data Lake10 min readData Lake10 min read
Jan 22, 2022Your Mission if you choose to accept itSo you want to change careers to become a developer, this is a very wise choice. Being a developer is in high demand and that’s not going to change as the need for new applications for every aspect of our lives are needed. …Developer6 min readDeveloper6 min read
