For radiometrically calibrating and PSF deconvolving IRIS data

Last update: Nov 01, 2022

Related tags

Overview

irispreppy

For radiometrically calibrating and PSF deconvolving IRIS data.

I dislike how I need to own proprietary software (IDL) just to simply prepare my data. I use Python for my analysis, why can't I radiometrically calibrate and deconvolve with it? This has been a passion project of mine during my PhD. The radiometric calibration keeps itself up to date with the response files by checking https://hesperia.gsfc.nasa.gov/ssw/iris/response/ every time it is run. If it finds new files, it downloads them before continuing.

These scripts should be general purpose and "just work". No janky hacks are present.

This remains untested on Windows and Mac. However, I expect it to work on UNIX-like OSes.

iris_get_response.pro translated by Aaron W. Peat.
fit_iris_xput.pro translated by Aaron W. Peat.
radcal.py authored by Aaron W. Peat
deconvolve.py authored by Aaron W. Peat

IRIS_SG_deconvolve.py authored by Dr Graham S. Kerr.
IRIS_SG_PSFs.pkl supplied by Dr Graham S. Kerr.

Special thanks to Dr C.M.J. Osborne (https://github.com/Goobley) for putting up with my incessant and innane questions.

Comments

Combination of HDU and `save=True` arguments to radiometric calibration

If an HDU is passed instead of a str containing a path, the code will attempt fitsHdu[-5:] + '_rc.fits'. Which is an issue that should be checked somewhere. This is likely an issue if a list is passed too.

opened by Goobley 1
Versioning and Install issues

The current pip version tries to get beautiful soup through bs4 (which fails on most python), and the current tree goes for beatifulsoup4 (typo). Try and sort the astropy requirements too? Is there an issue with >v4.2.0 ?

opened by Goobley 1
Code will always warn that you are offline

https://hesperia.gsfc.nasa.gov/ssw/iris/response is now a 404.

NASA have removed the public facing SSW page due to "hacking" after an attack took the site offline. I will have to find an alternate source for these files or attempt to update them manually.
bug

opened by OfAaron3 1
Calibration of Files Created after 2022-01-01 Have Significantly Less Flux

For the time being, it is recommended to use files predating 2022. This was found when comparing h2r intensities over time. On 2022-01-01 there is a discontinuity where these drop. This drop is not present in uncalibrated data.
bug

opened by OfAaron3 1

Releases(v0.9.9)

v0.9.9(Jan 6, 2023)

Added better psf deconvolution.
Source code(tar.gz)
Source code(zip)
v0.9.8(Dec 16, 2022)

Reverting reverted change. It was right.
Source code(tar.gz)
Source code(zip)
v0.9.7(Dec 16, 2022)

Wavelength issue fixed in version 4 has been reverted. This was not an issue, but a misunderstanding.
Source code(tar.gz)
Source code(zip)
v0.9.6(Nov 7, 2022)

Adds fix for rogue factor of 10
Source code(tar.gz)
Source code(zip)
v0.9.5(Nov 1, 2022)

A mistranslated IDL line is fixed. In my defence, it was arcane.
Source code(tar.gz)
Source code(zip)
v0.9.4(Aug 2, 2022)

Fixes issue when using HDUs as inputs instead of strings and an install typo.

As before, I can't guarantee this will work, tell me if it doesn't.
Source code(tar.gz)
Source code(zip)
v0.9.3(May 17, 2022)

I can't guarantee this will work, tell me if it doesn't.
Source code(tar.gz)
Source code(zip)

A program made in PYTHON🐍 that automatically performs data insertions into a POSTGRES database 🐘 , using as base a .CSV file 📁 , useful in mass data insertions

A program made in PYTHON🐍 that automatically performs data insertions into a POSTGRES database 🐘 , using as base a .CSV file 📁 , useful in mass data insertions.

1 Oct 17, 2022

Explore-bikeshare-data - GitHub project as part of the Programming for Data Science with Python Nanodegree from Udacity

Date created February 10, 2022 Project Title Explore US Bikeshare Data Descripti

1 Feb 14, 2022

Open-source data observability for modern data teams

Use cases Monitor your data warehouse in minutes: Data anomalies monitoring as dbt tests Data lineage made simple, reliable, and automated dbt operati

889 Jan 1, 2023

Vehicle Identification Speed Detection (VISD) extracts vehicle information like License Plate number, Manufacturer and colour from a video and provides this data in the form of a CSV file

Vehicle Identification Speed Detection (VISD) extracts vehicle information like License Plate number, Manufacturer and colour from a video and provides this data in the form of a CSV file. VISD can also perform vehicle speed detection on a video. All these features of VSID are provided to the user using a Web Application which is created using Flask

6 Feb 22, 2022

Council Data Project is an open-source project dedicated to providing journalists, activists, researchers, and all members of each community we serve with the tools they need to stay informed and hold their Council Members accountable.

CDP - Self Council Data Project Council Data Project is an open-source project dedicated to providing journalists, activists, researchers, and all mem

1 May 12, 2022

This is the core of the program which takes 5k SYMBOLS and looks back N years to pull in the daily OHLC data of those symbols and saves them to disc.

1 Jan 31, 2022

For radiometrically calibrating and PSF deconvolving IRIS data

Related tags

Overview

irispreppy

You might also like...

A program made in PYTHON🐍 that automatically performs data insertions into a POSTGRES database 🐘 , using as base a .CSV file 📁 , useful in mass data insertions

Explore-bikeshare-data - GitHub project as part of the Programming for Data Science with Python Nanodegree from Udacity

Open-source data observability for modern data teams

Vehicle Identification Speed Detection (VISD) extracts vehicle information like License Plate number, Manufacturer and colour from a video and provides this data in the form of a CSV file

Council Data Project is an open-source project dedicated to providing journalists, activists, researchers, and all members of each community we serve with the tools they need to stay informed and hold their Council Members accountable.

Process RunGap output file of a workout and load data into Apple Numbers Spreadsheet and my website with API calls

Run python scripts and pass data between multiple python and node processes using this npm module

Download and process GOES-16 and GOES-17 data from NOAA's archive on AWS using Python.

This is the core of the program which takes 5k SYMBOLS and looks back N years to pull in the daily OHLC data of those symbols and saves them to disc.

Comments

Combination of HDU and `save=True` arguments to radiometric calibration

Versioning and Install issues

Code will always warn that you are offline

Calibration of Files Created after 2022-01-01 Have Significantly Less Flux

Releases(v0.9.9)

v0.9.9(Jan 6, 2023)

v0.9.8(Dec 16, 2022)

v0.9.7(Dec 16, 2022)

v0.9.6(Nov 7, 2022)

v0.9.5(Nov 1, 2022)

v0.9.4(Aug 2, 2022)

v0.9.3(May 17, 2022)

Owner

Aaron W. Peat

Simple Assembler with python

NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for noisy labels).

Convert your Gyrosco.pe travels to GPX files

Safe temperature monitor for baby's room. Made for Raspberry Pi Pico.

Web UI for your scripts with execution management

Xbox-Flood is for flood anything

Tools for downloading and processing numerical weather predictions

UFDR2DIR - A script to convert a Cellebrite UFDR to the original file structure

Read and write life sciences file formats

Python AVL Protocols Server for Codec 8 and Codec 8 Extended Protocols

An assistant to guess your pip dependencies from your code, without using a requirements file.

A TODO-list tool written in Python

Node editor view image node

Example python package with pybind11 cpp extension

Anki Cards for the HSK vocabulary Chinese-German

How to create the game Rock, Paper, Scissors in Python

A tool for generating skill map/tree like diagram

Projeto de análise de dados com SQL

A python package for bitclout.

Python Script to add OpenGapps, Magisk, libhoudini translation library and libndk translation library to waydroid !