Skip to content

Commit

Permalink
[SPARK-7035] Encourage __getitem__ over __getattr__ on column access …
Browse files Browse the repository at this point in the history
…in the Python DataFrame API

Author: ksonj <kson@siberie.de>

Closes apache#5971 from ksonj/doc and squashes the following commits:

dadfebb [ksonj] __getitem__ is cleaner than __getattr__
  • Loading branch information
ksonj authored and nemccarthy committed Jun 19, 2015
1 parent 016e8a7 commit faf5a45
Showing 1 changed file with 8 additions and 3 deletions.
11 changes: 8 additions & 3 deletions docs/sql-programming-guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,6 @@ DataFrames provide a domain-specific language for structured data manipulation i

Here we include some basic examples of structured data processing using DataFrames:


<div class="codetabs">
<div data-lang="scala" markdown="1">
{% highlight scala %}
Expand Down Expand Up @@ -242,6 +241,12 @@ df.groupBy("age").count().show();
</div>

<div data-lang="python" markdown="1">
In Python it's possible to access a DataFrame's columns either by attribute
(`df.age`) or by indexing (`df['age']`). While the former is convenient for
interactive data exploration, users are highly encouraged to use the
latter form, which is future proof and won't break with column names that
are also attributes on the DataFrame class.

{% highlight python %}
from pyspark.sql import SQLContext
sqlContext = SQLContext(sc)
Expand Down Expand Up @@ -270,14 +275,14 @@ df.select("name").show()
## Justin

# Select everybody, but increment the age by 1
df.select(df.name, df.age + 1).show()
df.select(df['name'], df['age'] + 1).show()
## name (age + 1)
## Michael null
## Andy 31
## Justin 20

# Select people older than 21
df.filter(df.age > 21).show()
df.filter(df['age'] > 21).show()
## age name
## 30 Andy

Expand Down

0 comments on commit faf5a45

Please sign in to comment.