FastChangeCo – A Fictitious Company

FastChangeCo – A Fictitious Company

The company FastChangeCo is a fictitious company I developed in 2015 to illustrate problems, challenges and opportunities our customer had in their projects. I used FastChangeCo successfully during my talks, workshops, trainings, coaching and projects.

FastChangeCo is a company founded in the early 20th century. Today, we would say it was a Start Up. The founder, Mr. Fast, had great ideas for building assembly lines which came up in the early 20th century used by Ford and others. During the following decades his company grew to become a big player in the nineties of the last century.
Nowadays, FastChangeCo has thousands of employees and thousands of products in different industries and billions of revenue.

Data Model Scorecard

Data Model Scorecard

Objective review and data quality goals of data models

Did you ever ask yourself which score your data model would achieve? Could you imagine  90%, 95% or even 100% across 10 categories of objective criteria?

No?
Yes?

Either way, if you answered with “no” or “yes”, recommend using something to test the quality of your data model(s). For years there have been methods to test and ensure quality in software development, like ISTQB, IEEE, RUP, ITIL, COBIT and many more. In data warehouse projects I observed test methods testing everything: loading processes (ETL), data quality, organizational processes, security, …
But data models? Never! But why?

The Data Doctrine

The Data Doctrine

Message: Thank you for signing The Data Doctrine!

What a fantastic moment. I’ve just signed The Data Doctrine. What is the data doctrine? In a similar philosophy to the Agile Manifesto it offers us data geeks a data-centric culture:

Value Data Programmes1 Preceding Software Projects
Value Stable Data Structures Preceding Stable Code
Value Shared Data Preceding Completed Software
Value Reusable Data Preceding Reusable Code

While reading the data doctrine I saw myself looking around seeing all the lost options and possibilities in data warehouse projects because of companies, project teams, or even individuals ignoring the value of data by incurring the consequences. I saw it in data warehouse projects, struggling with the lack of stable data structures in source systems as well as in the data warehouse. In a new fancy system, where no one cares about which, what and how data was generated. And for a data warehouse project even worse, is the practice of keeping data locked with access limited to a few principalities of departments castles.
All this is not the way to get value out of corporate data, and to leverage it for value creation.

As I advocate flexible, lean and easily extendable data warehouse principles and practices, I’ll support the idea of The Data Doctrine to evolve the understanding for the need of data architecture as well as of data-centric principles.

So long,
Dirk

1 To emphasize the point, we (the authors of The Data Doctrine) use the British spelling of “programme” to reinforce the difference between a data programme, which is a set of structured activities and a software program, which is a set of instructions that tell a computer what to do (Wikipedia, 2016).

Sketch Notes Reflections at TDWI Roundtable with FCO-IM

Sketch Notes Reflections at TDWI Roundtable with FCO-IM

Our 25th anniversary roundtable in Frankfurt with FCO-IM was a great success. Almost 90 registrations and more than 60 attendees is an unexpected outcome for a topic that is almost unknown in Germany. If you want to know what happened at the roundtable, read about it in my previous blog post.

Reflections on Data Natives conference, October 2016

Reflections on Data Natives conference, October 2016

A conference for the data-driven generation!

It’s late October 2016, an incredible crowd of young data-driven peeps are on their way to Berlin, looking forward to meet many other peeps with the same attitude at the Data Natives conference: Doing business with data or seeing a huge value in using data for the future. Besides the crowd I was not only impressed by the location but also by the amount of startups at the conference.

The schedule for two days was full packed with talks and it wasn’t easy to choose between all these interesting topics. So I decided not to give myself too much pressure. Instead I cruised  through the program, and stumbled on some highlights.

Follow Up Data Vault EXASOL Webinar

Follow Up Data Vault EXASOL Webinar

{youtube}_tIdk52BxWU{/youtube}

In July 2016 Mathias Brink and I had given a webinar [LINK] how to implement Data Vault on a EXASOL database. Read more about in my previous blogpost or watch the recording on Youtube.

Afterward I became a lot of questions per our webinar. I’ll now answer all questions I got till today. If you have further more questions feel free to ask via my contact page,via Twitter, or write a comment right here.

FCO-IM at TDWI Roundtable

FCO-IM at TDWI Roundtable

FCO-IM - Data Modeling by Example

Do You want to visit a presentation about Fully Communication Oriented Information Modeling (FCO-IM) in Frankfurt?
I’m very proud that we, the board of the TDWI Roundtable FFM, could win Marco Wobben to speak about FCO-IM. In my opinion, it’s one of the most powerful technique for building conceptual information models. And the best is, that such models can be automatically transformed into ERM, UML, Relational or Dimensional models and much more. So we can gain more wisdom in data modeling at all.

But, what is information modeling? Information modeling is making a model of the language used to communicate about some specific domain of business in a more or less fixed way. This involved not only the words used but also typical phrases and patterns that combine these words into meaningful standard statements about the domain [3].

Look Back Over DMZ

Look Back Over DMZ

I was at the Data Modeling Zone Europe 2016 in Berlin as a speaker. It was the 4th Data Modeling Zone in Europe and in my opinion one of the best per the conference program and the interesting and awesome chats with other speakers and attendees. This year’s venue was the Abion Hotel in Berlin, situated next to the Spreebogen and for this a great environment around the venue.

DMZ Europe 2016

DMZ Europe 2016

This year’s European Data Modeling Zone (DMZ) will take place at the wonderful German capital Berlin and I’m very happy to be again speaker at this great event! This year I’ll speak about how to start with a conceptual model, using a logical model and finally how to model the physical Data Vault. During this session we will do some exercises (no, no push-ups!!) to bring our brains up and running about modeling.

Generating large example data with TPC-H

Generating large example data with TPC-H

Several times I had the need for some large data sets to do some Data Vault tests at customer site, writing a blogpost, doing a demo or a webinar and many more. And sometimes I need data to do performance or data usage tests on different databases. Due to my work together with EXASOL I focused on the TPC-H tool DBGen to generate gigabytes of data.

To share my experience with DBGen generating large data sets I wrote this blogpost as a step by step instruction.

Look Back Over TDWI 2016

Look Back Over TDWI 2016

Last week in June I was at the TDWI Conference 2016 at Munich. ITGAIN, my employer, had as a platin sponsor a booth to present our products and services!



In my point of view, it was another great TDWI conference at Munich with a lot of awesome people I could talk with - including an interesting discussion about data architecture with Mark (Madsen) and all the nonsense happening in the Big Data world.

High performance – Data Vault and Exasol

High performance – Data Vault and Exasol

You may have received an e-mail invitation from EXASOL or from ITGAIN inviting you to our forthcoming webinar, such as this:

Do you have difficulty incorporating different data sources into your current database? Would you like an agile development environment? Or perhaps you are using Data Vault for data modeling and are facing performance issues?
If so, then attend our free webinar entitled “Data Vault Modeling with EXASOL: High performance and agile data warehousing.” The 60-minute webinar takes place on July 15 from 10:00 to 11:00 am CEST.
High performance – Data Vault and Exasol

High performance – Data Vault and Exasol

You may have received an e-mail invitation from EXASOL or from ITGAIN inviting you to our forthcoming webinar, such as this:

Do you have difficulty incorporating different data sources into your current database? Would you like an agile development environment? Or perhaps you are using Data Vault for data modeling and are facing performance issues?
If so, then attend our free webinar entitled “Data Vault Modeling with EXASOL: High performance and agile data warehousing.” The 60-minute webinar takes place on July 15 from 10:00 to 11:00 am CEST.
Meetup – Data Vault Interest Group

Meetup – Data Vault Interest Group

I reactivated my Meetup Data Vault Interest Group this week. Long time ago I was thinking about a table of fellow regulars to network with other, let’s call them Data Vaulters. It should be a relaxed get-together, no business driven presentation or even worse advertisement for XYZ tool, consulting or any flavor of Data Vault. The feedback of many people was that they want something different to the existing Business Intelligence Meetings. So, here it is!

Meetup – Data Vault Interest Group

Meetup – Data Vault Interest Group

I reactivated my Meetup Data Vault Interest Group this week. Long time ago I was thinking about a table of fellow regulars to network with other, let’s call them Data Vaulters. It should be a relaxed get-together, no business driven presentation or even worse advertisement for XYZ tool, consulting or any flavor of Data Vault. The feedback of many people was that they want something different to the existing Business Intelligence Meetings. So, here it is!

Meetup – Data Vault Interest Group

Meetup – Data Vault Interest Group

I reactivated my Meetup Data Vault Interest Group this week. Long time ago I was thinking about a table of fellow regulars to network with other, let’s call them Data Vaulters. It should be a relaxed get-together, no business driven presentation or even worse advertisement for XYZ tool, consulting or any flavor of Data Vault. The feedback of many people was that they want something different to the existing Business Intelligence Meetings. So, here it is!

How to load easy some data vault test data

How to load easy some data vault test data

Some time ago a customers asked me how to load easy and simple some (test)data into their database XYZ (chose the one of your choice and replace XYZ) to test their new developed Data Vault logistic processes.
The point was: They don’t want to use all this ETL-tool and IT-processes overhead just to some small test in their own environment. If this this is well done from a data governance perspective? Well, that’s not part of this blogpost. Just do this kind of thingis only in your development environment.

How to load easy some data vault test data

How to load easy some data vault test data

Some time ago a customers asked me how to load easy and simple some (test)data into their database XYZ (chose the one of your choice and replace XYZ) to test their new developed Data Vault logistic processes.
The point was: They don’t want to use all this ETL-tool and IT-processes overhead just to some small test in their own environment. If this this is well done from a data governance perspective? Well, that’s not part of this blogpost. Just do this kind of thingis only in your development environment.

How to load easy some data vault test data

How to load easy some data vault test data

Some time ago a customers asked me how to load easy and simple some (test)data into their database XYZ (chose the one of your choice and replace XYZ) to test their new developed Data Vault logistic processes.
The point was: They don’t want to use all this ETL-tool and IT-processes overhead just to some small test in their own environment. If this this is well done from a data governance perspective? Well, that’s not part of this blogpost. Just do this kind of thingis only in your development environment.

Where did I and where will I speak (2016)

Where did I and where will I speak (2016)

Past, present and future, where did I speak and where will I speak at conferences?

Since my calendar fills up more and more with presentations at conferences I'll give you a summary to keep track on it. Some of them are already confirmed, for others I've submitted my abstracts but yet not confirmed.

Where did I and where will I speak (2016)

Where did I and where will I speak (2016)

Past, present and future, where did I speak and where will I speak at conferences?

Since my calendar fills up more and more with presentations at conferences I'll give you a summary to keep track on it. Some of them are already confirmed, for others I've submitted my abstracts but yet not confirmed.

Where did I and where will I speak (2016)

Where did I and where will I speak (2016)

Past, present and future, where did I speak and where will I speak at conferences?

Since my calendar fills up more and more with presentations at conferences I'll give you a summary to keep track on it. Some of them are already confirmed, for others I've submitted my abstracts but yet not confirmed.

Adventorial – Data Vault heißt die moderne Antwort

Adventorial – Data Vault heißt die moderne Antwort

Read the full article, I wrote, in OnlineThemenSpecial Data Vault, supported by BI-Spektrum.

So long
Dirk

OnlineSpezialDataVaultModeling ITGAIN Lerner BIS DataVault 2015

 

Adventorial – Data Vault heißt die moderne Antwort

Adventorial – Data Vault heißt die moderne Antwort

Read the full article, I wrote, in OnlineThemenSpecial Data Vault, supported by BI-Spektrum.

So long
Dirk

OnlineSpezialDataVaultModeling ITGAIN Lerner BIS DataVault 2015

 

High-performance Data Vault

High-performance Data Vault

Over the last few weeks, Mathias Brink and I have worked hard on the topic of Data Vault on EXASOL.

Our (simple) question: How does EXASOL perform with Data Vault?

First, we had to decide what kind of data to run performance tests against in order to get a feeling for the power of this combination. And we decided to use the well-known TPC-H benchmark created by the non-profit organisation TPC.

Second, we built a (simple) Data Vault model and loaded 500 GB of data into the installed model.  And to be honest, it was not the best model. On top of it we built a virtual TPC-H data model to execute the TPC-H SQLs in order to analyse performance.

Data Design – A Love Story

Data Design – A Love Story

{youtube}vdjToRow_6g{/youtube}

At the TDWI Conference 2015 in Munich Andreas Wiener (reportingimpulse) and I presented our brandnew idea about Data Design. ITGAIN, the company I'm working for, recorded the talk. Now the video is released! It's a great pleasure to me to present it to you!

Data Modeling Zone Europe 2015

Data Modeling Zone Europe 2015

DMZone2015Flyer

Do you want to learn something about data modelling with Steve Hoberman? You want to explore new methods like Data Vault 2.0, Anchor Modeling, Data Design, DMBOK and many more? E.g. a keynote where Dan Linstedt, Lars Rönnbäck and Hans Hultgren talks together, and another one with Bill Inmon?

Data Vault im Einsatz beim Gutenberg Rechenzentrum

Data Vault im Einsatz beim Gutenberg Rechenzentrum

Read the full article, I wrote, in BI-Spektrum 05/2014.

So long
Dirk

Data Vault im Einsatz beim Gutenberg Rechenzentrum

Data Vault heißt die moderne Antwort

Data Vault heißt die moderne Antwort

Read the full article in BI-Spektrum 03/2014.

Data Vault heit die moderne Antwort

World Wide Data Vault Consortium 2015

World Wide Data Vault Consortium 2015

Last week, there was it again. A meeting of Data Vault geeks and interested people in Data Vault! And again in the wonderful area of Vermont, USA. But these year we hat +30°C compared to last year’s -20°C. In Stowe, Vermont, the conference was held in the wonderful Trapp Family Lodge. To give you some more insights I’ll embed some of the tweets. If you want read the full timeline, go here!

Data Vault KISS – Keep it Small and Simple

Data Vault KISS – Keep it Small and Simple

KISS –

K – Keep (Data Vault)

I – It (ETL in your Data Warehouse)

S – Small (lightweight processes aka short and easy SQL)

S – and simple (easy Inserts and Updates)

Data Vault – Datenmodellierung noch notwendig?

Data Vault – Datenmodellierung noch notwendig?

Wie bereits in meinem Blogpost Modellierung oder Business Rule beschrieben ist es notwendig sich bei der Datenmodellierung über Geschäftsobjekte, die Wertschöpfungskette, fachliche Details und die Methodik des Modellierens einige Gedanken zu machen.

Oder doch nicht? Kann ich mit Data Vault einfach loslegen? Schließlich ist Data Vault auf den ersten Blick ganz einfach. Drei Objekte: HUBs, LINKs und SAT(elliten), einem einfachen Vorgehensmodell und ein paar wenige Regeln. Brauche ich für Data Vault noch die Datenmodellierung?

Data Vault Day Germany 2015

Data Vault Day Germany 2015

Zum ersten Mal gibt es in Deutschland den Data Vault Day. Das BI-Podium bringt uns einen ganzen Tag nur Data Vault, pures Data Vault :-) .

Auch Dan Linstedt, Begründer der Data Vault Methode, wird dabei sein. Lasst euch nicht die Chance entgehen ihn Live zu hören. Es ist eine der wenigen Möglichkeiten in Deutschland. Darüber hinaus könnt ihr direkt, mit ihm selbst, in den Networking-Slots reden, Fragen stellen oder euch einfach ein Autogramm geben lassen.

Konferenzhotel und WLAN?

Konferenzhotel und WLAN?

Oder wie ich einen HotSpot erstellte!

Manchmal ist es merkwürdig mit den Konferenzhotels. Genau in diesem Moment sitze ich in einem, mit in Deutschland. Überall drumherum gibt es LTE, nur hier im Hotel Edge. Hmm, „OK“ denkt sich der erfahrene Hotelgast, kein Problem: Schließlich gibt es kostenloses WLAN.

Ha, ja, das gibt es, aber nicht in den Zimmern oder nur bei richtige Windrichtung und Wetterlage. So der Haustechniker. Nunja, da habe ich wohl gerade das falsche Wetter erwischt.

Where did I and where will I speak

Where did I and where will I speak

Past, present and future, where did I speak and where will I speak at conferences?

Since my calendar fills up more and more with presentations at conferences I'll give you a summary to keep track on it. Some of them are already confirmed, for others I've submitted my abstracts but yet not confirmed.

Rüchschau DMZ Europe 2014

Rüchschau DMZ Europe 2014

Die Data Modeling Zone Europe 2014 ist zu Ende. Es waren zwei ereignisreiche Tage mit großartigen Sprechern und einem vollen Programm. In vier Tracks referierten namhafte Sprecher wie Dan Linstedt, Ronald Damhof, Martijn Evers, Karen Lopez und Rich van der Lans über Themen der Datenmodellierung, Big Data oder auch Industrie Datenmodelle.

2. Treffen der DDVUG

2. Treffen der DDVUG

Das 2. Treffen der Deutschsprachigen Data Vault User Group (#DDVUG) Treffen findet im Anschluss an die Data Modeling Zone (#DMZone14) 20141) in Hamburg statt.

Merkt euch daher unbedingt den 1. Oktober 2014 vor!

1:M – Link: Modellierung oder Business Rule?

1:M – Link: Modellierung oder Business Rule?

Auf dem 1. DDVUG Treffen hatten wir ein interessante Diskussion darüber, wo eigentlich die Datenmodellierung aufhört und Business Rules beginnen. Aufgehängt hatte sich dies an meiner Präsentation, in der es um einen Link ging, der eine 1:M (Hub A – (M) Link (1) – Hub B) Relation repräsentiert und über einen bi-temporalen Satelliten den gesteuert (end-dating) wird. So darf für jeden Eintrag im Hub B nur eine aktive Relation im Link existieren. Die Daten für das End-dating des Links kamen im von mir aufgeführten Beispiel bereits aus dem Quellsystem (Blogpost folgt bald).

1. Treffen der DDVUG

1. Treffen der DDVUG

Das 1. Deutschsprachige Data Vault User Group (#DDVUG) Treffen findet auf der TDWI Konferenz 2014 in München statt. Dan Linstedt wird als Ehrengast extra aus St. Albans zu unserem Treffen kommen und einen Vortrag über Data Vault halten.

Darüber hinaus wird es viele anregende Vorträge und Diskussionen aus der Praxis geben. Es soll schließlich der Austausch zwischen allen Teilnehmern gefördert, das Fachsimpeln und Netzwerken im Vordergrund stehen. Dazu die Organisatoren der DDVUG:

Rüchschau 1. DDVUG

Rüchschau 1. DDVUG

Am Dienstag, den 24. Juni 2014, war es so weit! Wir haben uns, viele Data Vault Begeisterte, zum ersten Mal in Form einer User Group getroffen!DDVUG Dan Linstedt und das Star Schema Im Zuge der TDWI 2014 Konferenz hatten wir die Möglichkeit uns ebenfalls im MOC in München zu treffen. Danke hier auch an das ganze Team des TDWI.

Super organisiert durch Christian Hädrich, war sogar Dan Linstedt als Ehrengast eingeladen. Sein Vortrag über die Entstehung von Data Vault war super anzuhören. Dieser soll in Kürze auf You Tube erscheinen. Wir sind gespannt.

18. TDWI Roundtable Frankfurt

18. TDWI Roundtable Frankfurt

Ende April habe ich, als Head of Competence – Agile Data Warehousing bei BLUEFORTE, einen Vortrag über Data Vault beim 18. TDWI Roundtable in Frankfurt/Main gehalten. Die Atmosphäre war super, die Organisation durch das TDWI toll und das Publikum ist mit Leidenschaft in Diskussionen eingestiegen.

Welche Zeit für Data Vault Timelines?

Welche Zeit für Data Vault Timelines?

Welche Zeit nehme ich für die Timelines in den Data Vault Entitäten? In meinen Projekten stellt sich immer wieder diese Frage. Dokumentiert das LoadDate im HUB, im LINK und im SAT den Load Date TimeStamp (LDTS) nach Dan Linstedt, oder doch die Transaction Time zu der Daten im Quellsystems entstanden sind? Oder besser die Extraktionszeit? Oder die Transaktionszeit der Datenbank1) zu der die Datenbank die Datensätze in die Tabellen speichert? Nicht einfach zu beantworten, oder?

Constraints im Data Vault

Constraints im Data Vault

Immer wieder kommt in Projekten die Frage auf, besser gesagt die Diskussion, ob Constraints in der Datenbank physisch sinnvoll sind oder nicht. Meist gibt es Vorgaben von DBAs oder durchsetzungsstarken ETLern, die eine generelle Abneigung gegen Constraints zu haben scheinen, dass Constraints nicht erwünscht sind. OK, diese Woche wurde mir wieder das Gegenteil bewiesen. Doch wie heißt es so schön: Ausnahmen ...

Auf dem #WWDVC und im Advanced Data Vault 2.0 Boot Camp haben wir ebenfalls über dieses Phänomen gesprochen. Das scheint weltweit zu existieren. Dazu hat kurz nach dem #WWDVC auch Kent Graziano einen Blogpost verfasst. Auf LinkedIn gab es dazu einige Kommentare.

Gut, wie argumentiert man am besten, bzw. was sind eigentlich die Vor- und Nachteile Constraints zu verwenden?

Direkt vom #WWDVC

Direkt vom #WWDVC

Nach dem Advanced Data Vault 2.0 Boot Camp fand im Anschluss das World Wide Data Vault Consortium statt, das allererste überhaupt. Ein historisches Ereignis. Ja, vor allem auch deswegen, wie viele geniale und intelligente Menschen die Mühen auf sich nahmen nach St. Albans, Vermont, USA zu kommen. Und wirklich weltweit: aus den USA, Kanada, Australien, Norwegen, Holland und Deutschland kamen die Teilnehmer, um von Dan Linstedt das Neueste über Data Vault 2.0 zu hören, aber auch den Keynotes und den viele Vorträgen zu folgen und sich in Networking Sessions untereinander auszutauschen.

Für alle Tweeds und noch mehr Infos: Geht auf Twitter mit #WWDVC!

Advanced Data Vault 2.0 Boot Camp

Advanced Data Vault 2.0 Boot Camp

Anreise

Die Anreise zur Schulung mit KLM verlief ohne Probleme. Von Frankfurt nach Montreal, mit einem kurzen Stopp in Amsterdam und dann entspannt mit dem Auto über verschneite Landschaften nach St. Albans, VT, USA.

Auf dem Flug nach Amsterdam gab es viel Spaß im Flieger, da einer der Supervisors an Board seinen letzten Flug auf dieser Maschine hatte und sein Team ihn gebührend verabschiedete.

Privacy Policy

Copyright © 2017 BBBT - All Rights Reserved
Powered by WordPress & Atahualpa
X