* Update namespace to Microsoft.Data.Analysis

* Remove "DataFrame" from the test project name

* Support reverse binary operators

* Fix file left behind in a rebase

* Fix whitespace

* Throw if inPlace is set and types mismatch

* Unit test

* Better error message

* Remove empty lines

* Version, Tags and Description for Nuget

* sq

* Publish packages to artifacts

* Flags for release

* Fix the Description method to not crash
Adds an Info method

* sq

* Address feddback

* Last round of feedback

* Fix LoadCsv to use dataType if it passed in

* sq

* Don't read the full file after guessRows lines have been read

* Address feedback

* Last round of feedback

* Rows collection, similar to Columns

* Doc

* Some minor clean up

* Make DataFrameRow a view into the DataFrame

* sq

* Address feedback

* Remove DataFrame.RowCount

* More row count changes

* sq

* Address feedback

* Merge upstream

…3.0 (dotnet#2797)

Fixing by passing in an encoding and a default buffer size.

Also, get our tests running on .NET Framework.

Fix dotnet#2783

* Params constructor on DataFrame

* Delete redundant constructors

…ns (dotnet#2801)

* Remove T : unmanaged constraint from DataFrameColumn.BinaryOperations

* Address feedback

* Rename the value version of the APIs

* sq

* Fix build

* Address feedback

* Remove Value from the APIs

* sq

* Address feedback

* Add Apply method to PrimitiveDataFrameColumn and its container

* Add TestApply test

* Remove unused df variable in DataFrameTests

* Add xml doc comments to Apply method

* Add additional tests for ReadCsv

* Update asserts

* Add empty row and skip test pending another fix

* Remove test for another issue

* Added static factory methods to DataFrameColumn where they make sense (for the overloads where its possible to infer the column's type).

* Remove regions

* Update some parts of the unit tests to use static factory methods to create DataFrameColumns.

* Remove errant {T} on StringDataFrameColumn.

* PR feedback

Co-authored-by: Eric Erhardt <eric.erhardt@microsoft.com>

* Append rows to a DataFrame

* Unit test

* Update unit tests and doc

* Need to perfrom a type check every time

* sq

* Update unit test

* Address comments

* Add eng folder

* First cut of moving corefxlab to arcade

* Move arcade symbol validation inside official buil

* Move base yml file to root

* Arcade will build, publish packages and symbols

* UpdateXlf. Review this

* Arcade Update to version 5.0.0-beta.19575.4 to include Experimental Channel

* Remove property that was causing the build to fail

* Moving global properties to the main Yaml instead of step in order to unblock publishing

* Committing xlfs and changing the build script to not update Xlf on build

* clean up corefxlab-base.yml

* sq

* Delete unused files and scripts

* Get rid of all the xlf stuff

* Remove UpdateXlfOnBuild for non-NT builds

* Minor cleanup

* More cleanup

* update eng\build.sh permission

* Rename to Nuget.config

* sq

* Remove the runtime spec from global.json

* Don't publish test projs

* Typo

* Move version prefix to versions.props
Change prereleaselabel to alpha

* Increment version number to list as the latest package
Increment version number of Microsoft.Experimental.Collections to list as the latest package
Turn off graph generation

* Update the Readme

* Test removing the scripts folder

* Touch readme to force a change

* Address Jose's comments

* Typo

* Move versions to eng/versions.props

* Benchmark.proj needs to refer to xunit

* Clean up dependencies.props

* Remove dependencies.props

Co-authored-by: Jose Perez Rodriguez <joperezr@microsoft.com>

* Rename sort to orderby and add orderbydescending method

* Add doc strings

* Update bench mark test

* Update tests

* Update DataFrameColumn to use orderby

* Update doc comment

* Additions to sortby

* Revert "Additions to sortby"

This reverts commit 3931d4e2a72ce44a539be7c27b2592395f3efd35.

* Revert "Update doc comment"

This reverts commit 192f7797fe2b77625486637badf77046162fedbf.

* Revert "Update DataFrameColumn to use orderby"

This reverts commit 8f94664c5fd18570cd2b601535e816ca5dd5e3c4.

* Explode column types and generate converters

* Clean this

* sq

* sq

* Cherry pick for next commit

* sq

* Undo unnecessary change

…2861)

* Move string indexer to Columns

* API changes from the 2nd API review

* Unit tests

* Address comments

)

* Generate combinations of binary operations and Add

* Numeric Converters and CloneAsNumericColumns

* Binary, Comparison and Shift operations

* Clean up and bug fix

* Fix the binary op apis to not be overridden

* Internal constructors for exploded types

* Proper return types for exploded types

* Update unit tests

* Update csproj

* Revert "Fix the binary op apis to not be overridden"

This reverts commit 2dc2240c9449930139c1492d1388d5e1f8ba5fa1.

* Bug fix and unit test

* Constructor that takes in a container

* Unit tests

* Call the implementation where possible

* Review sq

* sq

* Cherry pick for next commit

* sq

* Undo unnecessary change

* Rename to the system namespace column types

* Address comments

* Push to pull locally

* Mimic C#'s arithmetic grammar in DataFrame

* Address feedback

* Reduce the number of partial column definitions

* Address feedback

)

* CP

* sq

* sq

* Improve docs

* Enable xml docs for Data.Analysis

* Fix /// summary around inheritdoc

* Minor doc changes

* sq

* sq

* Address feedback

…2885)

* Support for Exploded columns types in Arrow and IO scenarios

* Unit tests

* Address feedback

* Fix versioning to allow for individual stable packages

* sq

* Bump Microsoft.Data.Analysis version to 0.4.0

* Fix dotnet/corefxlab#2906

* Improvements and unit tests

* sq

* Better fix

* sq

…otnet#2916)

* Unit test to repro

* Fix dotnet/corefxlab#2915

Append a null value to a column when encountering it instead of changing the column type to a StringDataFrameColumn

* Update src/Microsoft.Data.Analysis/DataFrame.IO.cs

Co-authored-by: Günther Foidl <gue@korporal.at>

* Update src/Microsoft.Data.Analysis/DataFrame.cs

Co-authored-by: Günther Foidl <gue@korporal.at>

* Feedback

Co-authored-by: Günther Foidl <gue@korporal.at>

This reverts commit 0bef531.

* Increment version and stop producing stable packages

* Add DataFrame object formatter.

* Update nuget dependencies.

* Apply CR fixes.

* Add DataFrame object formatter.

* Update nuget dependencies.

* Apply CR fixes.

* Remove ReferenceOutputAssembly added to from Microsoft.Data.Analysys.csproj.

* Add Microsoft.Data.Analysis.nuget project.

* Move project to src. Fix nuget project settings.

* Remove NoBuild property from project.

* Remove IncludeBuildOutput and IncludeSymbols from project.

* Add VersionPrefix to project.

* Add IncludeBuildOutput property.

* Add unit tests.

* Downgrade from netcoreapp3.1 to netcoreapp3.0

* Upgrade from netcoreapp3.0 to netcoreapp3.1 (dotnet interactive is not compatible with 3.0)

* Add netcoreapp3.1 to global settings

* Add dotnet 3.1.5 runtime to global settings

* Build fixes

* Moving MDAI into interactive-extensions folder of the package

* Minor refactoring

* Respond to PR feedback

Co-authored-by: Prashanth Govindarajan <prgovi@microsoft.com>
Co-authored-by: Jose Perez Rodriguez <joperezr@microsoft.com>
Co-authored-by: Eric Erhardt <eric.erhardt@microsoft.com>

* ColumnName indexer on DataFrame

Fixes dotnet/corefxlab#2934

* Unit tests

* Null column name

…lse (dotnet#2956)

* implement FillNulls method for ArrowStringDataFrameColumn

* additional asserts for testcase

…net#2939)

* resolves dotnet#2806

* replace forloop with ArraySegment<T>

* reduce shuffle loop operations from O(Rows.Count) to O(numberOfRows)

* Add WriteCsv plus unit tests.

* Add CultureInfo to WriteCsv. Remove index column param. Update unit tests.

* Add CR changes. CultureInfo. Separator.

* Format decimal types individually. Fix culture info. Fix unit tests.

* Format decimal types individually. Fix culture info. Fix unit tests.

* Make LoadCsv more robust

* Test empty string column

* Retain prev guess where possible

* Support for RecordBatches with StructArrays

* Sq

* Address comments

* Nits

* Nits

* Implement DataFrame.LoadCsvFromString

* Address comments

Make MDA.test use the props defined TFM
Comment out 2 unit tests