Skip to content

Commit

Permalink
fix ponder
Browse files Browse the repository at this point in the history
  • Loading branch information
anna-geller committed Aug 13, 2023
1 parent a5766b4 commit f51806f
Show file tree
Hide file tree
Showing 3 changed files with 2 additions and 6 deletions.
8 changes: 2 additions & 6 deletions content/blogs/2023-08-11-dataframes.md
Original file line number Diff line number Diff line change
Expand Up @@ -317,15 +317,11 @@ top = (

top.to_json("bestsellers_ponder.json", orient="records")
```

While the setup guide was helpful, I couldn't solve our use case with Ponder.

Ponder created 14 intermediate tables in my BigQuery dataset (yes, 14!) to perform that simple task, and it didn't even succeed in generating a JSON file as output. See the screenshot below for reference.
It took some time but eventually Ponder was able to finish the task. However, it also created 14 intermediate tables in my BigQuery dataset (yes, 14!) to perform that simple task. See the screenshot below for reference.

![ponder](/blogs/2023-08-11-dataframes/ponder.png)


My overall impression is that Ponder seems like an interesting product for big data as it executes everything in a cloud data warehouse such as BigQuery. It seems pretty early, though — I got a bunch of errors even when following the getting started guide.
My overall impression is that Ponder seems like an interesting product for big data as it executes everything in a cloud data warehouse such as BigQuery. However, for our use case, Ponder felt a bit too *heavy*.

Next, let's look at **Fugue**, which also provides a distributed dataframe abstraction that can run on top of BigQuery, Dask, Spark, DuckDB, and more.

Expand Down
Binary file removed content/blogs/ponder.png
Binary file not shown.
Binary file modified public/blogs/2023-08-11-dataframes/ponder.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

1 comment on commit f51806f

@vercel
Copy link

@vercel vercel bot commented on f51806f Aug 13, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Successfully deployed to the following URLs:

kestra-io – ./

kestra-io-git-main-kestra.vercel.app
kestra-io-kestra.vercel.app
kestra-io.vercel.app

Please sign in to comment.