Schema validation for Xarray objects

Last update: Oct 31, 2022

Related tags

Data Visualization xarray-schema

Overview

xarray-schema

Schema validation for Xarray

installation

This package is in the early stages of development. Install it from source:

pip install git+git://github.com/carbonplan/xarray-schema

usage

Xarray-schema's API is modeled after Pandera. The DataArraySchema and DatasetSchema objects both have .validate() methods.

The basic usage is as follows:

import numpy as np
import xarray as xr
from xarray_schema import DataArraySchema, DatasetSchema

da = xr.DataArray(np.ones(4, dtype='i4'), dims=['x'], name='foo')

schema = DataArraySchema(dtype=np.integer, name='foo', shape=(4, ), dims=['x'])

schema.validate(da)

roadmap

This is a very early prototype of a library. Some key things are missing:

Validation of coords, chunks, and attrs. None of these are implemented yet.
Class-based schema's for parts of the Xarray data model. Most validations are currently made as direct comparisons (da.name == self.name) but a more robust approach is possible that leverages classes for each component of the data model. We're already handling some special cases using None as a sentinel value to allow for wildcard-like behavior in places (i.e. dims and shape)
Exceptions: Pandera accumulates schema exceptions and reports them all at once. Currently, we are a eagerly raising SchemaErrors when the are found.

license

All the code in this repository is MIT licensed, but we request that you please provide attribution if reusing any of our digital content (graphics, logo, articles, etc.).

about us

CarbonPlan is a non-profit organization working on the science and data of carbon removal. We aim to improve the transparency and scientific integrity of carbon removal and climate solutions through open data and tools. Find out more at carbonplan.org or get in touch by opening an issue or sending us an email.

Comments

Fix/ignore typing errors and add mypy to ci
Thanks for this package! It looks like it could very useful!

I thought I would contribute by adding type checking.

Fix some typing errors

Ignore some other typing errors that seem to be caused by an incompatibility between the use of properties in this project and what mypy expects.

Add mypy to dev requirements

Add mypy to CI using invoke

Add invoke to dev requirements

I tried to add a mypy pre-commit hook, but this caused pre-commit CI to fail. I think this may be because the pre-commit CI is not able to install the correct requirements.
opened by paiforsyth 4
Bump mypy from 0.982 to 0.990
Bumps mypy from 0.982 to 0.990.

Commits

b71dc3d Remove +dev from version

719cef9 Add support for exception groups and except* (#14020)

91b6fc3 Fix crash on nested unions in recursive types (#14007)

42a4c69 Make TryStar not crash (#13991)

5fad1ac Warn on invalid *args and **kwargs with ParamSpec (#13892)

184add9 Revert sum literal integer change (#13961)

74e0dff Add hidden options to disable bytes promotion (#13952)

ec6d9d9 [mypyc] Fix ircheck if register is initialized through LoadAddress (#13944)

8ef701d Use 3.11 instead of 3.11-dev (#13945)

ec149da [mypyc] Fix glue methods with native int types (#13939)

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot will merge this PR once it's up-to-date and CI passes on it, as requested by @andersy005.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies python
opened by dependabot[bot] 3
Bump actions/setup-python from 2.3.2 to 3.1.0
Bumps actions/setup-python from 2.3.2 to 3.1.0.

Release notes

Sourced from actions/setup-python's releases.

Support caching poetry dependencies and caching on GHES 3.5

In the scope of this release, we added support for caching from GHES 3.5 and fixed the download issue for files > 2GB during restore.

Caching poetry dependencies

steps: - uses: actions/[email protected] - name: Install poetry run: pipx install poetry - uses: actions/[email protected] with: python-version: '3.9' cache: 'poetry' - run: poetry install - run: poetry run pytest

v3.0.0

What's Changed

Update default runtime to node16 (actions/setup-python#340)

Update package-lock.json file version to 2, @types/node to 16.11.25 and typescript to 4.2.3 (actions/setup-python#341)

Remove legacy pypy2 and pypy3 keywords (actions/setup-python#342)

Breaking Changes

With the update to Node 16, all scripts will now be run with Node 16 rather than Node 12.

This new major release removes support of legacy pypy2 and pypy3 keywords. Please use more specific and flexible syntax to specify a PyPy version:

jobs: build: runs-on: ubuntu-latest strategy: matrix: python-version: - 'pypy-2.7' # the latest available version of PyPy that supports Python 2.7 - 'pypy-3.8' # the latest available version of PyPy that supports Python 3.8 - 'pypy-3.8-v7.3.8' # Python 3.8 and PyPy 7.3.8 steps: - uses: actions/[email protected] - uses: actions/[email protected] with: python-version: ${{ matrix.python-version }}

See more usage examples in the documentation

Commits

9c644ca Update README.md to fix setup-python version in example (#368)

3e8e90e dist fix (#367)

05fb98d Cache on ghes (#363)

6c56602 Merge pull request #281 from patrick91/feature/poetry-caching

9516be8 Merge pull request #358 from actions/brcrista/codeql-main

7aa3e95 Update dist

6c31eb3 Use \n instead of os.EOL

7a37d78 Update dist

e4be7a4 Initialise pyproject.toml

aac0ef9 Build and format

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot will merge this PR once CI passes on it, as requested by @andersy005.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies github_actions
opened by dependabot[bot] 3
Chunks
Three changes:

Building out some checks in the chunks schema.

Adding a check that the input is actually a da, since if it's a dataset the chunk routines will fail for the wrong reason.

Remove the return of the da at the end since I think we just want it to continue without returning anything.
opened by orianac 3
parsing method in xarray-schema

hi,

thanks for the really great package. I was wondering if there is any plan to also provide methods for parsing array-like data following the pre-defined schemas. In particular, similar to what xarray-dataclasses provides.

possibly related to #12

thanks!

opened by giovp 2
Bump actions/cache from 3.0.8 to 3.0.9
Bumps actions/cache from 3.0.8 to 3.0.9.

Release notes

Sourced from actions/cache's releases.

v3.0.9

Enhanced the warning message for cache unavailability in case of GHES.

Changelog

Sourced from actions/cache's changelog.

3.0.8

Fix zstd not working for windows on gnu tar in issues #888 and #891.

Allowing users to provide a custom timeout as input for aborting download of a cache segment using an environment variable SEGMENT_DOWNLOAD_TIMEOUT_MIN. Default is 60 minutes.

3.0.9

Enhanced the warning message for cache unavailablity in case of GHES.

Commits

ac80757 Actions/cache release 3.0.9 (#930)

0ff0597 Update examples.md (#920)

1268184 Update README.md (#936)

1a78ace Updated the GHES warning message (#925)

1bc650b Merge pull request #922 from actions/vsvipul/add-anurag

92e01f4 Add anuragc617 to assignees

b195c99 Merge pull request #912 from actions/pdotl/readme-update-1

9f98a2f Merge branch 'main' into pdotl/readme-update-1

471fb0c Move workarounds to a different file

a213d1e Merge pull request #913 from actions/vsvipul-patch-2

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot will merge this PR once it's up-to-date and CI passes on it, as requested by @andersy005.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies github_actions
opened by dependabot[bot] 2
Bump types-setuptools from 65.1.0 to 65.3.0
Bumps types-setuptools from 65.1.0 to 65.3.0.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot will merge this PR once it's up-to-date and CI passes on it, as requested by @andersy005.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies python
opened by dependabot[bot] 2
Bump types-setuptools from 63.4.0 to 64.0.1
Bumps types-setuptools from 63.4.0 to 64.0.1.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies python
opened by dependabot[bot] 2
Bump types-setuptools from 63.4.0 to 64.0.0
Bumps types-setuptools from 63.4.0 to 64.0.0.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies python
opened by dependabot[bot] 2
Bump actions/cache from 3.0.6 to 3.0.7
Bumps actions/cache from 3.0.6 to 3.0.7.

Release notes

Sourced from actions/cache's releases.

v3.0.7

What's Changed

Fix for the download stuck problem has been added in actions/cache for users who were intermittently facing the issue. As part of this fix, new timeout has been introduced in the download step to stop the download if it doesn't complete within an hour and run the rest of the workflow without erroring out.

Changelog

Sourced from actions/cache's changelog.

3.0.6

Fixed #809 - zstd -d: no such file or directory error

Fixed #833 - cache doesn't work with github workspace directory

3.0.7

Fixed #810 - download stuck issue. A new timeout is introduced in the download process to abort the download if it gets stuck and doesn't finish within an hour.

Commits

a7c34ad Merge pull request #894 from actions/kotewar/update-toolkit-version

83394c9 Updated cache version in license file

e839c25 Updated actions/cache version to 3.0.3

33a923d Added release information

a404368 Updated actions/cache version to 3.0.2

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies github_actions
opened by dependabot[bot] 2
Bump actions/cache from 3.0.5 to 3.0.6
Bumps actions/cache from 3.0.5 to 3.0.6.

Release notes

Sourced from actions/cache's releases.

v3.0.6

What's Changed

Add example for clojure lein project dependencies by @shivamarora1 in PR actions/cache#835

Update toolkit's cache npm module to latest. Bump cache version to v3.0.6 by @pdotl in PR actions/cache#887

Fix issue #809 where cache save/restore was failing for Amazon Linux 2 runners due to older tar version

Fix issue #833 where cache save was not working for caching github workspace directory

New Contributors

@shivamarora1 made their first contribution in actions/cache#835

@pdotl made their first contribution in actions/cache#887

Full Changelog: https://github.com/actions/cache/compare/v3...v3.0.6

Changelog

Sourced from actions/cache's changelog.

3.0.5

Removed error handling by consuming actions/cache 3.0 toolkit, Now cache server error handling will be done by toolkit. (PR)

3.0.6

Fixed #809 - zstd -d: no such file or directory error

Fixed #833 - cache doesn't work with github workspace directory

Commits

f427802 Merge pull request #887 from actions/pdotl-version-patch

9916fe1 Update cache version in licences

318935e Update README and RELEASES

85efbb5 Update cache npm module to latest

4387dbc Merge pull request #835 from shivamarora1/clojure-lein-example

71e3ee5 Add phantsure to PR reviewers

c316eb7 Add phantsure to issue assignment

a0e530f feat: 🎸 add example for clojure lein project deps

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies github_actions
opened by dependabot[bot] 2
Bump types-setuptools from 65.6.0.2 to 65.6.0.3
Bumps types-setuptools from 65.6.0.2 to 65.6.0.3.

Commits

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies python
opened by dependabot[bot] 0
Bump actions/cache from 3.2.2 to 3.2.3
Bumps actions/cache from 3.2.2 to 3.2.3.

Release notes

Sourced from actions/cache's releases.

v3.2.3

What's Changed

Add Mint example by @uhooi in actions/cache#1051

Fixed broken link by @kotewar in actions/cache#1057

Add support to opt-in enable cross-os caching on windows by @Phantsure in actions/cache#1056

Release support for cross-os caching as opt-in feature by @Phantsure in actions/cache#1060

New Contributors

@uhooi made their first contribution in actions/cache#1051

Full Changelog: https://github.com/actions/cache/compare/v3...v3.2.3

Changelog

Sourced from actions/cache's changelog.

3.2.2

Reverted the changes made in 3.2.1 to use gnu tar and zstd by default on windows.

3.2.3

Support cross os caching on Windows as an opt-in feature.

Fix issue with symlink restoration on Windows for cross-os caches.

Commits

58c146c Release support for cross-os caching as opt-in feature (#1060)

6fd2d45 Add support to opt-in enable cross-os caching on windows (#1056)

1f41429 Fixed broken link (#1057)

365406c Merge pull request #1051 from uhooi/feature/add_mint_example

d621756 Update Mint example

84e5400 Merge remote-tracking branch 'origin/main' into feature/add_mint_example

See full diff in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies github_actions
opened by dependabot[bot] 0
Bump mypy from 0.982 to 0.991
Bumps mypy from 0.982 to 0.991.

Commits

b7788fc Update version to remove "+dev" for releasing 0.991

6077d19 manually CP typeshed #9130

ab0ea1e Fix crash with function redefinition (#14064)

592a9ce Fix another crash with report generation on namespace packages (#14063)

1650ae0 Update --no-warn-no-return docs for empty body changes (#14065)

b9daa31 Don't ignore errors in files passed on the command line (#14060)

02fd8a5 Filter out wasm32 wheel in upload-pypi.py (#14035)

131c8d7 Fix crash on inference with recursive alias to recursive instance (#14038)

1368338 Change version to 0.991+dev in preparation for the point release

b71dc3d Remove +dev from version

Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot will merge this PR once CI passes on it, as requested by @andersy005.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR

@dependabot recreate will recreate this PR, overwriting any edits that have been made to it

@dependabot merge will merge this PR after your CI passes on it

@dependabot squash and merge will squash and merge this PR after your CI passes on it

@dependabot cancel merge will cancel a previously requested merge and block automerging

@dependabot reopen will reopen this PR if it is closed

@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually

@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)

@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

dependencies python
opened by dependabot[bot] 3
Minimal Dataset coords and dims validation

What would be the minimal implementation to be merged here?

My use case is simply to check if a dataset has specific coords and dims. I could go one step further to check that each coord is indexed by specific dim.

I might just give this a try, but is there a can of worms I am simply not anticipating here?

Cheers!

https://github.com/carbonplan/xarray-schema/blob/a25777c55dde98d5732f48423706da4fc81cd1fd/xarray_schema/dataset.py#L60
good first issue

opened by ljstrnadiii 2
Extract schema from xarray objects
One way users may want to generate schemas is from xarray objects directly. We could add a utility here that supports this workflow.

This could be a function

schema = create_schema(ds)

Or a class method:

schema = DatasetSchema.from_dataset(ds)

Or as an Xarray accessor extension:

schema = ds.schema.create()
enhancement good first issue
opened by jhamman 0

Releases(0.0.3)

0.0.3(Apr 5, 2022)
What's Changed

update np.typing import by @jhamman in https://github.com/carbonplan/xarray-schema/pull/29

Full Changelog: https://github.com/carbonplan/xarray-schema/compare/0.0.2...0.0.3
Source code(tar.gz)
Source code(zip)
0.0.2(Apr 5, 2022)
What's Changed

expose SchemaError in init by @tcchiao in https://github.com/carbonplan/xarray-schema/pull/14

New Contributors

@tcchiao made their first contribution in https://github.com/carbonplan/xarray-schema/pull/14

Full Changelog: https://github.com/carbonplan/xarray-schema/compare/0.0.1...0.0.2
Source code(tar.gz)
Source code(zip)

Owner

carbonplan

Data and science for climate action

GitHub Repository

Graphical display tools, to help students debug their class implementations in the Carcassonne family of projects

carcassonne_tools Graphical display tools, to help students debug their class implementations in the Carcassonne family of projects NOTE NOTE NOTE The

1 Nov 08, 2021

ICS-Visualizer is an interactive Industrial Control Systems (ICS) network graph that contains up-to-date ICS metadata

ICS-Visualizer is an interactive Industrial Control Systems (ICS) network graph that contains up-to-date ICS metadata (Name, company, port, user manua

2 Dec 13, 2021

Tidy data structures, summaries, and visualisations for missing data

naniar naniar provides principled, tidy ways to summarise, visualise, and manipulate missing data with minimal deviations from the workflows in ggplot

611 Dec 22, 2022

Advanced hot reloading for Python

The missing element of Python - Advanced Hot Reloading Details Reloadium adds hot reloading also called "edit and continue" functionality to any Pytho

1.9k Jan 04, 2023

Seaborn is one of the go-to tools for statistical data visualization in python. It has been actively developed since 2012 and in July 2018, the author released version 0.9. This version of Seaborn has several new plotting features, API changes and documentation updates which combine to enhance an already great library. This article will walk through a few of the highlights and show how to use the new scatter and line plot functions for quickly creating very useful visualizations of data.

12_Python_Seaborn_Module Introduction 👋 From the website, “Seaborn is a Python data visualization library based on matplotlib. It provides a high-lev

192 Dec 16, 2022

Visual Python is a GUI-based Python code generator, developed on the Jupyter Notebook environment as an extension.

564 Jan 03, 2023

Data parsing and validation using Python type hints

pydantic Data validation and settings management using Python type hinting. Fast and extensible, pydantic plays nicely with your linters/IDE/brain. De

12.1k Jan 06, 2023

High-level geospatial data visualization library for Python.

geoplot: geospatial data visualization geoplot is a high-level Python geospatial plotting library. It's an extension to cartopy and matplotlib which m

1k Jan 01, 2023

A curated list of awesome Dash (plotly) resources

Awesome Dash A curated list of awesome Dash (plotly) resources Dash is a productive Python framework for building web applications. Written on top of

1.7k Jan 07, 2023

a python function to plot a geopandas dataframe

Pretty GeoDataFrame A minimum python function (~60 lines) to draw pretty geodataframe. Based on matplotlib, shapely, descartes. Installation just use

27 Dec 05, 2022

Visualize the bitcoin blockchain from your local node

Project Overview A new feature in Bitcoin Core 0.20 allows users to dump the state of the blockchain (the UTXO set) using the command dumptxoutset. I'

18 Sep 11, 2022

Open-questions - Open questions for Bellingcat technical contributors

Open questions for Bellingcat technical contributors These are difficult, long-term projects that would contribute to open source investigations at Be

234 Dec 31, 2022

Fast visualization of radar_scenes based on oleschum/radar_scenes

RadarScenes Tools About This python package provides fast visualization for the RadarScenes dataset. The Open GL based visualizer is smoother than ole

2 Dec 09, 2021

A way of looking at COVID-19 data that I haven't seen before.

Visualizing Omicron: COVID-19 Deaths vs. Cases Click here for other countries. Data is from Our World in Data/Johns Hopkins University. About this pro

1 Jan 10, 2022

📊 Charts with pure python

A zero-dependency python package that prints basic charts to a Jupyter output Charts supported: Bar graphs Scatter plots Histograms 🍑 📊 👏 Examples

54 Oct 04, 2022

Visualize and compare datasets, target values and associations, with one line of code.

In-depth EDA (target analysis, comparison, feature analysis, correlation) in two lines of code! Sweetviz is an open-source Python library that generat

2.3k Jan 05, 2023

Massively parallel self-organizing maps: accelerate training on multicore CPUs, GPUs, and clusters

Somoclu Somoclu is a massively parallel implementation of self-organizing maps. It exploits multicore CPUs, it is able to rely on MPI for distributing

239 Nov 10, 2022

Typical: Fast, simple, & correct data-validation using Python 3 typing.

typical: Python's Typing Toolkit Introduction Typical is a library devoted to runtime analysis, inference, validation, and enforcement of Python types

171 Jan 02, 2023

AB-test-analyzer - Python class to perform AB test analysis

AB-test-analyzer Python class to perform AB test analysis Overview This repo con

13 Jul 16, 2022

CLAHE Contrast Limited Adaptive Histogram Equalization

A simple code to process images using contrast limited adaptive histogram equalization. Image processing is becoming a major part of data processig.

4 May 18, 2022

Schema validation for Xarray objects

Related tags

Overview

xarray-schema

installation

usage

roadmap

license

about us

Comments

Support caching poetry dependencies and caching on GHES 3.5

v3.0.0

What's Changed

Breaking Changes

v3.0.9

3.0.8

3.0.9

v3.0.7

What's Changed

3.0.6

3.0.7

v3.0.6

What's Changed

New Contributors

3.0.5

3.0.6

v3.2.3

What's Changed

New Contributors

3.2.2

3.2.3

Releases(0.0.3)

0.0.3(Apr 5, 2022)

What's Changed

0.0.2(Apr 5, 2022)

What's Changed

New Contributors

Owner

carbonplan

Graphical display tools, to help students debug their class implementations in the Carcassonne family of projects

ICS-Visualizer is an interactive Industrial Control Systems (ICS) network graph that contains up-to-date ICS metadata

Tidy data structures, summaries, and visualisations for missing data

Advanced hot reloading for Python

Visual Python is a GUI-based Python code generator, developed on the Jupyter Notebook environment as an extension.

Data parsing and validation using Python type hints

High-level geospatial data visualization library for Python.

A curated list of awesome Dash (plotly) resources

a python function to plot a geopandas dataframe

Visualize the bitcoin blockchain from your local node

Open-questions - Open questions for Bellingcat technical contributors

Fast visualization of radar_scenes based on oleschum/radar_scenes

A way of looking at COVID-19 data that I haven't seen before.

📊 Charts with pure python

Visualize and compare datasets, target values and associations, with one line of code.

Massively parallel self-organizing maps: accelerate training on multicore CPUs, GPUs, and clusters

Typical: Fast, simple, & correct data-validation using Python 3 typing.

AB-test-analyzer - Python class to perform AB test analysis

CLAHE Contrast Limited Adaptive Histogram Equalization