-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathindex.html
295 lines (232 loc) · 10.4 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
<meta name="HandheldFriendly" content="True" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<meta name="robots" content="index, follow" />
<link href="https://fonts.googleapis.com/css2?family=Source+Code+Pro:ital,wght@0,400;0,700;1,400&family=Source+Sans+Pro:ital,wght@0,300;0,400;0,700;1,400&display=swap" rel="stylesheet">
<link rel="stylesheet/less" type="text/css" href="https://tobtob.de/theme/stylesheet/style.less">
<script src="//cdnjs.cloudflare.com/ajax/libs/less.js/2.5.1/less.min.js" type="text/javascript"></script>
<link id="pygments-light-theme" rel="stylesheet" type="text/css"
href="https://tobtob.de/theme/pygments/github.min.css">
<script src="https://tobtob.de/theme/js/lite-yt-embed.js"></script>
<link rel="stylesheet" type="text/css" href="https://tobtob.de/theme/font-awesome/css/fontawesome.css">
<link rel="stylesheet" type="text/css" href="https://tobtob.de/theme/font-awesome/css/brands.css">
<link rel="stylesheet" type="text/css" href="https://tobtob.de/theme/font-awesome/css/solid.css">
<link rel="stylesheet" type="text/css" href="https://tobtob.de/theme/stylesheet/lite-yt-embed.css">
<link href="https://tobtob.de/feeds/all.atom.xml" type="application/atom+xml" rel="alternate" title="Tobias Kaymak"s Blog Atom">
<meta name="author" content="Tobias Kaymak" />
<meta name="description" content="Random Notes about Data Engineering - the personal blog of Tobias Kaymak" />
<meta property="og:site_name" content="Tobias Kaymak"s Blog"/>
<meta property="og:type" content="blog"/>
<meta property="og:title" content="Tobias Kaymak"s Blog"/>
<meta property="og:description" content="Random Notes about Data Engineering - the personal blog of Tobias Kaymak"/>
<meta property="og:locale" content="en_US"/>
<meta property="og:url" content="https://tobtob.de"/>
<meta property="og:image" content="https://tobtob.de/images/profile.png">
<title>Tobias Kaymak"s Blog</title>
</head>
<body class="light-theme">
<aside>
<div>
<a href="https://tobtob.de/">
<img src="https://tobtob.de/images/profile.png" alt="Random Notes about Data Engineering" title="Random Notes about Data Engineering">
</a>
<h1>
<a href="https://tobtob.de/">Random Notes about Data Engineering</a>
</h1>
<p>Tobias Kaymak</p>
<nav>
<ul class="list">
<li>
<a target="_self"
href="https://tobtob.de/about.html#about">
about
</a>
</li>
</ul>
</nav>
<ul class="social">
<li>
<a class="sc-linkedin" href="https://www.linkedin.com/in/tobias-kaymak/" target="_blank">
<i class="fab fa-linkedin"></i>
</a>
</li>
<li>
<a class="sc-github" href="https://github.com/tkaymak" target="_blank">
<i class="fab fa-github"></i>
</a>
</li>
<li>
<a class="sc-stack-overflow" href="https://stackoverflow.com/users/5497956/tobi" target="_blank">
<i class="fab fa-stack-overflow"></i>
</a>
</li>
</ul>
</div>
</aside>
<main>
<nav>
<a href="https://tobtob.de/">Home</a>
<a href="/archives.html">Archives</a>
<a href="/categories.html">Categories</a>
<a href="https://tobtob.de/feeds/all.atom.xml">Atom</a>
</nav>
<article>
<header>
<h2><a href="https://tobtob.de/beam-summit-2023.html#beam-summit-2023">Too big to fail - a Beam Pattern for enriching a Stream using State and Timers</a></h2>
<p>
Posted on Tue 01 August 2023 in <a href="https://tobtob.de/category/apache-beam.html">Apache Beam</a>
</p>
</header>
<div>
<div><p>The recording of my talk at the Beam Summit 2023, discussing a pattern for
enriching streaming data using state and timers, is now available:</p>
<p><lite-youtube videoid="1t4MP8_vIUY" playlabel="Play: Beam Summit 2023 Talk"></lite-youtube></p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/beam-summit-2022.html#beam-summit-2022">Playing the Long Game: Transforming Ricardo's Data Infrastructure with Apache Beam</a></h2>
<p>
Posted on Wed 03 August 2022 in <a href="https://tobtob.de/category/apache-beam.html">Apache Beam</a>
</p>
</header>
<div>
<div><p>The recording of my talk at the Beam Summit 2022 about building real-time data pipelines, from running our own Apache Flink cluster on-premise to the fully managed GCP Dataflow service, is now available:</p>
<p><lite-youtube videoid="v-MclVrGJcQ" playlabel="Play: Beam Summit 2022 Talk"></lite-youtube></p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/biengine-script.html#biengine-script">Python script to control BI Engine Reservations</a></h2>
<p>
Posted on Sat 07 May 2022 in <a href="https://tobtob.de/category/google-bigquery.html">Google BigQuery</a>
</p>
</header>
<div>
<div><p>I wrote a small Python script to be able to create and delete <a href="https://cloud.google.com/bigquery/docs/bi-engine-intro">BI Engine</a> reservations for Google Cloud <a href="https://cloud.google.com/bigquery/docs/introduction">BigQuery</a>. I used this script in a cronjob to disable BI Engine on the weekends/during the nights to save some costs and see how well the system is with and …</p></div>
<br>
<a class="btn"
href="https://tobtob.de/biengine-script.html#biengine-script">
Continue reading
</a>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/apache-beam-case-study.html#apache-beam-case-study">Apache Beam Case Study</a></h2>
<p>
Posted on Fri 03 December 2021 in <a href="https://tobtob.de/category/apache-beam.html">Apache Beam</a>
</p>
</header>
<div>
<div><p>In a case study for Apache Beam, I described how the framework enables Ricardo to evolve into a smarter second-hand marketplace. You can find it <a href="https://beam.apache.org/case-studies/ricardo/">on the Apache Beam website</a>.</p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/beam-summit-2021.html#beam-summit-2021">You belong together - detecting linked accounts at Ricardo</a></h2>
<p>
Posted on Fri 06 August 2021 in <a href="https://tobtob.de/category/apache-beam.html">Apache Beam</a>
</p>
</header>
<div>
<div><p>The recording of my talk at the Beam Summit 2021 about one of our first
production pipelines created with the Python SDK is now available on YouTube:</p>
<p><lite-youtube videoid="LXnh9jNNfYY" playlabel="Play: Beam Summit 2021 Talk"></lite-youtube></p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/gcp-meetup-zurich-2021.html#gcp-meetup-zurich-2021">GCP Zurich Meetup #8</a></h2>
<p>
Posted on Tue 16 March 2021 in <a href="https://tobtob.de/category/talks.html">Talks</a>
</p>
</header>
<div>
<div><p>At the GCP Meetup #8 in Zurich, I've talked about how the Google BigQuery data warehouse can benefit from the NoSQL database Cloud Bigtable, by using Bigtable as a fast key-based lookup store for point queries:</p>
<p><lite-youtube videoid="9ClukrXRndc" playlabel="Play: GCP Meetup Zurich #8 Talk"></lite-youtube></p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/apache-kafka.html#apache-kafka">8 Years of Event Streaming with Apache Kafka</a></h2>
<p>
Posted on Tue 02 February 2021 in <a href="https://tobtob.de/category/apache-kafka.html">Apache Kafka</a>
</p>
</header>
<div>
<div><p>A post for the Confluent blog about my personal history with Apache Kafka is availabe <a href="https://www.confluent.io/blog/batch-to-streams-8-years-of-event-streaming-with-apache-kafka/">here</a>.</p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/google-cloud-bigtable.html#google-cloud-bigtable">Why we chose Bigtable to complement BigQuery</a></h2>
<p>
Posted on Thu 14 January 2021 in <a href="https://tobtob.de/category/google-cloud.html">Google Cloud</a>
</p>
</header>
<div>
<div><p>I've contributed a blog post for the GCP Blog about our use of Bigtable at Ricardo.
You can read it <a href="https://cloud.google.com/blog/products/databases/choosing-cloud-native-bigtable-to-save-data-warehouse-costs">here</a>.</p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/beam-summit-2020.html#beam-summit-2020">Four Apache Technologies Combined for Fun and Profit</a></h2>
<p>
Posted on Wed 26 August 2020 in <a href="https://tobtob.de/category/apache-beam.html">Apache Beam</a>
</p>
</header>
<div>
<div><p>The recording of my talk at the Online Beam Summit 2020 is now available on YouTube:</p>
<p><lite-youtube videoid="PiwLC-YK_Zw" playlabel="Play: Beam Summit Europe 2020 Talk"></lite-youtube></p></div>
</div>
<hr />
</article>
<article>
<header>
<h2><a href="https://tobtob.de/beam-summit-2019.html#beam-summit-2019">From database dumps to streaming - Ricardo.ch's Beam journey</a></h2>
<p>
Posted on Tue 18 June 2019 in <a href="https://tobtob.de/category/apache-beam.html">Apache Beam</a>
</p>
</header>
<div>
<div><p>My talk at the Beam Summit Europe 2019 is now available on YouTube:</p>
<p><lite-youtube videoid="EcvnFH5LDE4" playlabel="Play: Beam Summit Europe 2019 Talk"></lite-youtube></p></div>
</div>
</article>
<div class="pagination">
<a class="btn float-left" href="https://tobtob.de/index2.html">
<i class="fa fa-angle-left"></i> Older Posts
</a>
</div>
<footer>
<p>© 2023 </p>
<p>
Built with <a href="http://getpelican.com" target="_blank">Pelican</a> using <a href="http://bit.ly/flex-pelican" target="_blank">Flex</a> theme
</p> </footer>
</main>
<script type="application/ld+json">
{
"@context" : "http://schema.org",
"@type" : "Blog",
"name": " Tobias Kaymak"s Blog ",
"url" : "https://tobtob.de",
"image": "https://tobtob.de/images/profile.png",
"description": "Random Notes about Data Engineering - the personal blog of Tobias Kaymak"
}
</script>
</body>
</html>