Skip to content

Commit

Permalink
Done first pass
Browse files Browse the repository at this point in the history
  • Loading branch information
scottsand-db committed Sep 12, 2023
1 parent 70ad00f commit 5b1b621
Show file tree
Hide file tree
Showing 6 changed files with 9 additions and 34 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,7 @@
Delta Lake is an open-source storage framework that enables building a [Lakehouse architecture](http://cidrdb.org/cidr2021/papers/cidr2021_paper17.pdf) with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.
* See the [Delta Lake Documentation](https://docs.delta.io) for details.
* See the [Quick Start Guide](https://docs.delta.io/latest/quick-start.html) to get started with Scala, Java and Python.
* Note, this repo is one of many Delta Lake repositories in the [delta.io](https://github.com/delta-io) organizations including
[connectors](https://github.com/delta-io/connectors),
* Note, this repo is one of many Delta Lake repositories in the [delta.io](https://github.com/delta-io) organizations including
[delta](https://github.com/delta-io/delta),
[delta-rs](https://github.com/delta-io/delta-rs),
[delta-sharing](https://github.com/delta-io/delta-sharing),
Expand All @@ -19,7 +18,7 @@ Delta Lake is an open-source storage framework that enables building a [Lakehous
The following are some of the more popular Delta Lake integrations, refer to [delta.io/integrations](https://delta.io/integrations/) for the complete list:

* [Apache Spark™](https://docs.delta.io/): This connector allows Apache Spark™ to read from and write to Delta Lake.
* [Apache Flink (Preview)](https://github.com/delta-io/connectors/tree/master/flink): This connector allows Apache Flink to write to Delta Lake.
* [Apache Flink (Preview)](https://github.com/delta-io/delta/tree/master/connectors/flink): This connector allows Apache Flink to write to Delta Lake.
* [PrestoDB](https://prestodb.io/docs/current/connector/deltalake.html): This connector allows PrestoDB to read from Delta Lake.
* [Trino](https://trino.io/docs/current/connector/delta-lake.html): This connector allows Trino to read from and write to Delta Lake.
* [Delta Standalone](https://docs.delta.io/latest/delta-standalone.html): This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.
Expand Down
6 changes: 3 additions & 3 deletions build.sbt
Original file line number Diff line number Diff line change
Expand Up @@ -882,10 +882,10 @@ lazy val flink = (project in file("connectors/flink"))
autoScalaLibrary := false, // exclude scala-library from dependencies
Test / publishArtifact := false,
pomExtra :=
<url>https://github.com/delta-io/connectors</url>
<url>https://github.com/delta-io/delta</url>
<scm>
<url>git@github.com:delta-io/connectors.git</url>
<connection>scm:git:git@github.com:delta-io/connectors.git</connection>
<url>git@github.com:delta-io/delta.git</url>
<connection>scm:git:git@github.com:delta-io/delta.git</connection>
</scm>
<developers>
<developer>
Expand Down
24 changes: 0 additions & 24 deletions connectors/README.md

This file was deleted.

4 changes: 2 additions & 2 deletions connectors/flink/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Flink/Delta Connector

[![License](https://img.shields.io/badge/license-Apache%202-brightgreen.svg)](https://github.com/delta-io/connectors/blob/master/LICENSE.txt)
[![License](https://img.shields.io/badge/license-Apache%202-brightgreen.svg)](https://github.com/delta-io/delta/blob/master/LICENSE.txt)

Official Delta Lake connector for [Apache Flink](https://flink.apache.org/).

Expand Down Expand Up @@ -28,7 +28,7 @@ Official Delta Lake connector for [Apache Flink](https://flink.apache.org/).
## Introduction

Flink/Delta Connector is a JVM library to read and write data from Apache Flink applications to Delta tables
utilizing the [Delta Standalone JVM library](https://github.com/delta-io/connectors#delta-standalone).
utilizing the [Delta Standalone JVM library](https://github.com/delta-io/delta/tree/master/connectors#delta-standalone).
The connector provides exactly-once delivery guarantees.

Flink/Delta Connector includes:
Expand Down
2 changes: 1 addition & 1 deletion connectors/hive/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# Hive Connector
This project is a library to make Hive read Delta tables. The project provides a uber JAR `delta-hive-assembly_<scala_version>-<delta_connectors_version>.jar` to use in Hive. You can use either Scala 2.11, 2.12 or 2.13. The released JARs are available in the [releases](https://github.com/delta-io/connectors/releases) page. Please download the uber JAR for the corresponding Scala version you would like to use.
This project is a library to make Hive read Delta tables. The project provides a uber JAR `delta-hive-assembly_<scala_version>-<delta_connectors_version>.jar` to use in Hive. You can use either Scala 2.11, 2.12 or 2.13. The released JARs are available in the [releases](https://github.com/delta-io/delta/releases) page. Please download the uber JAR for the corresponding Scala version you would like to use.

You can also use the following instructions to build it as well.

Expand Down
2 changes: 1 addition & 1 deletion connectors/powerbi/fn_ReadDeltaTable.pq
Original file line number Diff line number Diff line change
Expand Up @@ -349,7 +349,7 @@ let
Documentation.Description = "Takes the file/folder list of a Delta Lake table and returns the content as a table object in Power Query.",
Documentation.LongDescription = "Takes the file/folder list of a Delta Lake table and returns the content as a table object in Power Query. An optional 2nd parameter can be used to for special features like Time Travel, Partition Elimination, etc.",
Documentation.Category = "Table",
Documentation.Source = "https://github.com/delta-io/connectors/blob/master/powerbi/fn_ReadDeltaTable.pq",
Documentation.Source = "https://github.com/delta-io/delta/blob/master/connectors/powerbi/fn_ReadDeltaTable.pq",
Documentation.Version = "1.0",
Documentation.Author = "Gerhard Brueckl, paiqo GmbH",
Documentation.Examples = {[Description = "Reading Delta Lake table from Azure Blob Storage with Time-Travel",
Expand Down

0 comments on commit 5b1b621

Please sign in to comment.