feat: create 1000 small tables for testing #19

betodealmeida · 2021-03-08T17:27:37Z

SUMMARY

apache#13448 added a new option -b to superset load-examples, that when enabled will create synthetic "big data" to test features and migrations on a realistic environment.

This PR adds 1000 small tables, to test loading tables in SQL Lab.

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

N/A

TEST PLAN

Ran superset load-examples -b -t and verified that tables are created.

ADDITIONAL INFORMATION

* prevent working timeout and grace period from being set to negative numbers * add extra validation * lint * fix black * fix isort * add js tests * fix lint + more python schema validation * add report schema test for timeout limits * add extra test for null grace period

Co-authored-by: Ville Brofeldt <ville.v.brofeldt@gmail.com>

* fix: button margin glitches * removing unncessary fragment * removing grid gap * Revert "removing unncessary fragment" This reverts commit 659e273.

* refactor(api): csrf token on the new REST API * improve OpenAPI spec description * fix test * remove public role like has default for all tests * fix test

…#13235) raise_for_dashboard_access is part of dashboard and cannot be overridden by a security manager.

…pache#13220)

…ache#13284)

…he#12238) * Update index.mdx Pinot connection fix * Update index.mdx

* feat: add trino logo Signed-off-by: Đặng Minh Dũng <dungdm93@live.com> * chores: update image links in README.md Signed-off-by: Đặng Minh Dũng <dungdm93@live.com> * docs: add Trino Connecting to Databases doc Signed-off-by: Đặng Minh Dũng <dungdm93@live.com>

…13304)

* update preset file * migration added * bug fix * lint * Update superset/migrations/versions/1412ec1e5a7b_legacy_force_directed_to_echart.py Co-authored-by: Jesse Yang <jesse.yang@airbnb.com> * version bump * bummp dependency * add package.lock * merge migrations * add integration test * lint * remove unnecessary params from test * check key existance in migrations * test to typescript * Update graph.test.ts * fix migration downstream head * Upgrade to lockfileversion 2 Co-authored-by: Jesse Yang <jesse.yang@airbnb.com>

…ache#13271) * feat(chart-data): add rowcount, timegrain and column result types * break out actions from query_context * rename module

* fix: project None value * fix: pre-commit

* First pass at ephemeral env, new Docker ci target * Add service checks, get public IP * Separate issue_comment and workflow_run jobs * Refactor workflows * Adjust comment author association * Checkout code * Fix image name, manage service desired task count * Use merge commit sha * Fix IP output, add failure comment * Refactor comment parsing & env spinup * Check container image publish status * Parse AWS account ID from registry URL * Use PR number rather than variable merge commit SHA for image tag * Fix docker push conditional * Push multiple tags to ECR * Fix comment author check * Refactor comment body check * Provision service with active task to get correct IP * /testenv up * Add @mentions to PR comments, env var cleanup

* fix: add config to disable dataset ownership on the old api * fix CI docker build * fix logic * add deprecation comment on the config * feat: send alerts reports errors to recipients * update * feat(reports): send notification on error with grace * merge and revert config * fix lint and MySQL test * fix mysql tests

* Enhance custom icon * Minor fix * Move DashboardList icon trash icon to enhanced * Enhance trash icon on lists * Enhance actions icons card view * Add storybook entry for custom icons * Test delete button * Remove commented line * Fix linting issue * Enhance Antd icons * Enhance existing icons up to BoltSmallRunIcon * Remove unused import * Import/Exports all icons from index * Export all existing icons * Implement more enhanced icons * Add data-id on edit buttons * Fix lint issue * Inherit color * Apply original color to actions * Fix linting issue * Fix typo * Change ModeHoriz to MoreHoriz

…3330) * fix: date picker support date unit with singular and plural * fix grammar

* test: optimize codecov config to let GitHub checks always pass * Run tests on workflow changes, too

* tests for DeleteModal component * fix: test attribute * removing config from DeleteModal.test.tsx * re-run tests * Update superset-frontend/src/components/DeleteModal/DeleteModal.test.tsx Co-authored-by: Jesse Yang <jesse.yang@airbnb.com> * Update superset-frontend/src/components/DeleteModal/DeleteModal.test.tsx Co-authored-by: Jesse Yang <jesse.yang@airbnb.com> * Update superset-frontend/src/components/DeleteModal/DeleteModal.test.tsx Co-authored-by: Jesse Yang <jesse.yang@airbnb.com> * Update superset-frontend/src/components/DeleteModal/DeleteModal.test.tsx Co-authored-by: Jesse Yang <jesse.yang@airbnb.com> Co-authored-by: Jesse Yang <jesse.yang@airbnb.com>

apache#13468) Co-authored-by: Beto Dealmeida <roberto@dealmeida.net>

* feat(native-filters): add timegrain and column filter * add fetch values predicate * bump deps * lint * fix test * add python test for legacy merge * fix default value and isInitialized to not check strict equality * Address comments * add FilterValue type * address review comments

* Ephemeral env PR close cleanup action * Add documentation for test envs

) * test: Adds storybook to PopoverSection component * test: Adds tests and storybook to PopoverSection component

* refactor(native-filters): move data mask to root reducer * refactor: update rest stuff for dataMask * refactor: add ownCrrentState to explore * fix: fix immer reducer * fix: merge with master * refactor: support explore dataMask * refactor: support explore dataMask * docs: add comment * refactor: remove json stringify * fix: fix failed cases * feat: filter bat buttons start * fix: fix CR notes * fix: fix cascade filters * fix: fix CR notes * refactor: add clear all * fix: fix CR notes * fix: fix CR notes * fix: fix CR notes * feat: buttons in filter bar * lint: update imports * feat: add tabs for filter sets * feat: add buttons to filter set * feat: first phase add filter sets * fix: undo FF * refactor: continue filter sets * fix: fix CR notes * refactor: header * fix: fix CR notes * fix: fix CR notes * refactor: continue filter sets * lint: fix lint * refactor: continue filter sets * fix: fix filter bar opening * refactor: continue filter sets * refactor: continue filter sets * refactor: continue filter sets * feat: filters sets history * feat: filters sets history * fix: filter set name * refactor: fix expand filters case * fix: fix CR notes * refactor: filter sets * fix: fix CR notes * refactor: filter sets

* refactor(native-filters): move data mask to root reducer * refactor: update rest stuff for dataMask * refactor: add ownCrrentState to explore * fix: fix immer reducer * fix: merge with master * refactor: support explore dataMask * refactor: support explore dataMask * docs: add comment * refactor: remove json stringify * fix: fix failed cases * feat: filter bat buttons start * fix: fix CR notes * fix: fix cascade filters * fix: fix CR notes * refactor: add clear all * fix: fix CR notes * fix: fix CR notes * fix: fix CR notes * feat: buttons in filter bar * lint: update imports * feat: add tabs for filter sets * feat: add buttons to filter set * feat: first phase add filter sets * fix: undo FF * refactor: continue filter sets * fix: fix CR notes * refactor: header * fix: fix CR notes * fix: fix CR notes * refactor: continue filter sets * lint: fix lint * refactor: continue filter sets * fix: fix filter bar opening * refactor: continue filter sets * refactor: continue filter sets * refactor: continue filter sets * feat: filters sets history * feat: filters sets history * fix: filter set name * refactor: fix expand filters case * fix: fix CR notes * refactor: filter sets * refactor: filter sets * refactor: filter sets * refactor: filter sets * refactor: update sets * feat: edit filter set * refactor: add warning icon * fix: fix CR notes * Update superset-frontend/src/dashboard/components/nativeFilters/FilterBar/FilterSets/EditSection.tsx Co-authored-by: Ville Brofeldt <33317356+villebro@users.noreply.github.com> * fix: fix CR notes Co-authored-by: Ville Brofeldt <33317356+villebro@users.noreply.github.com>

apache#13513) * Move to dir and add storybook * Add tests * Remove no-restricted-imports

* feat: add connector for CrateDB * added crate * fix PyPI reference * add tests * added more clarity on installing crate * fix test Co-authored-by: Ville Brofeldt <ville.v.brofeldt@gmail.com>

* feat(native-filters): add sort option to select filter * remove from useEffect * disable flaky cypress tests

* WIP * feat: add option to load big/wide tables * Fix lint * Address comments

* feat(dashboard) dashboard/id/datasets endpoint * schema for dashboard datasets * list instead of map * finish dashboard dataset schema * description * better test * add the dataset schema to the schema list * lint

Add new core modules from incubator-superset

* fix: show only necessary ticks on log scale and add storybook * fix: storybook path

Ran following commands: ``` brew install pngquant pngquant --quality=65-80 ./packages/**/*.png --ext .png --force ```

michael-s-molina and others added 30 commits February 22, 2021 11:06

test: add Tests and Storybook for AsyncAceEditor (apache#13241)

741219e

fix reports/commands_tests (apache#12864)

974f447

Co-authored-by: Ville Brofeldt <ville.v.brofeldt@gmail.com>

fix: migration script message formatting issue (apache#13262)

c020792

fix(home): missing key and invalid dates in Recents cards (apache#13291)

af3a460

fix schedules tests (apache#12870)

a5a31e0

Co-authored-by: Ville Brofeldt <ville.v.brofeldt@gmail.com>

fix: style tweaks for inconsistent button spacing (apache#13254)

8db5d43

* fix: button margin glitches * removing unncessary fragment * removing grid gap * Revert "removing unncessary fragment" This reverts commit 659e273.

fixing chart keys in MultiLineViz (apache#12937)

e37c2bf

refactor(api): csrf token on the new REST API (apache#13212)

9e2455a

* refactor(api): csrf token on the new REST API * improve OpenAPI spec description * fix test * remove public role like has default for all tests * fix test

fix(alerts): Handle None on results (apache#13289)

6e31212

refactor: Move raise_for_dashboard_access to security manager (apache…

99a0c8a

…#13235) raise_for_dashboard_access is part of dashboard and cannot be overridden by a security manager.

test: Switching FlashProvider to function component & creating tests (a…

6297ad7

…pache#13220)

fix(listview): preserve bulk selections when view mode is changed (ap…

75677f4

…ache#13284)

test: use data-test for testIdAttribute (apache#13292)

e4a0233

Migrates Collapse component from Bootstrap to AntD (apache#12920)

9a05d6a

chore: update instructions for Pinot in connecting to databases (apac…

3fbd44e

…he#12238) * Update index.mdx Pinot connection fix * Update index.mdx

fix(test): change data-test-id to data-test in FlashProvider (apache#…

8ef52ba

…13304)

feat(chart-data): add rowcount, timegrain and column result types (ap…

0a00153

…ache#13271) * feat(chart-data): add rowcount, timegrain and column result types * break out actions from query_context * rename module

fix: exception when saving dash (apache#13300)

29d6420

* fix: project None value * fix: pre-commit

Use redis:latest in docker-compose workflow (apache#13323)

970e473

fix: date picker support date unit with singular and plural (apache#1…

94d0bb9

…3330) * fix: date picker support date unit with singular and plural * fix grammar

test: optimize codecov config (apache#13329)

d39bc14

* test: optimize codecov config to let GitHub checks always pass * Run tests on workflow changes, too

sql Lab buttons (apache#13174)

7766857

test: Adds tests to URLShortLinkButton component (apache#13319)

7272184

hughhhh and others added 17 commits March 9, 2021 08:17

feat: add event_logger to test_connection and create_database commands (

c91c455

apache#13468) Co-authored-by: Beto Dealmeida <roberto@dealmeida.net>

build(test env): Shutdown test environments on PR close (apache#13452)

b21d2cf

* Ephemeral env PR close cleanup action * Add documentation for test envs

test: Adds storybook to AlteredSliceTag component (apache#13516)

6d2d3ad

test: Adds storybook and tests to AsyncEsmComponent (apache#13517)

f0a9dcc

test: Adds tests and storybook to PopoverSection component (apache#13438

fc36de2

) * test: Adds storybook to PopoverSection component * test: Adds tests and storybook to PopoverSection component

build: ignore Storybook stories in CodeCov (apache#13421)

9e964f4

Fixed KeyError by making kwarg explicit (apache#13505)

226dd4b

fix: fix initial filter loading (apache#13546)

70ccc26

fix: IS NULL filter operator for numeric columns (apache#13496)

b9884fb

test: Tests, dedicated directory and Storybook for the Badge component (

d1f6245

apache#13513) * Move to dir and add storybook * Add tests * Remove no-restricted-imports

build: check potential db migration conflict for open PRs (apache#13498)

5fca19d

feat: add connector for CrateDB (apache#13152)

bebac59

* feat: add connector for CrateDB * added crate * fix PyPI reference * add tests * added more clarity on installing crate * fix test Co-authored-by: Ville Brofeldt <ville.v.brofeldt@gmail.com>

test: TableCollection (apache#13583)

b5ea5d0

test: CronPicker (apache#13549)

fd4e5c8

eschutho approved these changes Mar 11, 2021

View reviewed changes

villebro and others added 4 commits March 11, 2021 16:49

feat(native-filters): add sort option to select filter (apache#13569)

901acd9

* feat(native-filters): add sort option to select filter * remove from useEffect * disable flaky cypress tests

feat: add option to load big/wide tables (apache#13448)

1470e70

* WIP * feat: add option to load big/wide tables * Fix lint * Address comments

refactor: convert controlUtils to TypeScript (2 of 2) (apache#13520)

7656b2e

feat(dashboard): dashboard/id/datasets endpoint (apache#13523)

1b95ed7

* feat(dashboard) dashboard/id/datasets endpoint * schema for dashboard datasets * list instead of map * finish dashboard dataset schema * description * better test * add the dataset schema to the schema list * lint

betodealmeida force-pushed the ch6268 branch from d14f3d8 to 65a87ce Compare March 12, 2021 02:26

betodealmeida changed the base branch from ch5457 to master March 12, 2021 02:27

feat: add more big data for testing

5caae72

betodealmeida force-pushed the ch6268 branch from 65a87ce to 5caae72 Compare March 12, 2021 02:28

betodealmeida closed this Mar 12, 2021

betodealmeida pushed a commit that referenced this pull request Dec 8, 2021

Merge pull request #19 from apache-superset/kristw--new-core

7097a0e

Add new core modules from incubator-superset

betodealmeida pushed a commit that referenced this pull request Dec 8, 2021

fix: show only necessary tick labels on log scale (#19)

49a6951

* fix: show only necessary ticks on log scale and add storybook * fix: storybook path

betodealmeida pushed a commit that referenced this pull request Dec 8, 2021

chore: compress thumbnails with pngquant (#19)

36c9805

Ran following commands: ``` brew install pngquant pngquant --quality=65-80 ./packages/**/*.png --ext .png --force ```

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: create 1000 small tables for testing #19

feat: create 1000 small tables for testing #19

betodealmeida commented Mar 8, 2021

feat: create 1000 small tables for testing #19

feat: create 1000 small tables for testing #19

Conversation

betodealmeida commented Mar 8, 2021

SUMMARY

BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF

TEST PLAN

ADDITIONAL INFORMATION