Using OpenAI's CLIP to upscale and enhance images

Last update: Jun 14, 2022

Overview

CLIP Upscaler and Enhancer

Using OpenAI's CLIP to upscale and enhance images

Based on nshepperd's JAX CLIP Guided Diffusion v2.4

Sample Results

Viewport	Original Image (512x512)	Using This Repo (scaled to 1024x1024 in 45 minutes)	Using Waifu2x (scaled to 1024x1024 in a few seconds)
Full Image
Zoomed In

How it works

Start with any image.
Find CLIP's embeddings of the image.
Resize the image to the desired resolution and add some noise.
Optimize the resized image for the original image's embeddings (using nshepperd's JAX CLIP Guided Diffusion v2.4).

Owner

Tripp Lyons

Blockchain/Ethereum/Solidity, Web Dev, Security

GitHub Repository

Pyramid Pooling Transformer for Scene Understanding

Pyramid Pooling Transformer for Scene Understanding Requirements: torch 1.6+ torchvision 0.7.0 timm==0.3.2 Validated on torch 1.6.0, torchvision 0.7.0

119 Dec 29, 2022

Supervised 3D Pre-training on Large-scale 2D Natural Image Datasets for 3D Medical Image Analysis

Introduction This is an implementation of our paper Supervised 3D Pre-training on Large-scale 2D Natural Image Datasets for 3D Medical Image Analysis.

24 Dec 06, 2022

Python scripts using the Mediapipe models for Halloween.

Mediapipe-Halloween-Examples Python scripts using the Mediapipe models for Halloween. WHY Mainly for fun. But this repository also includes useful exa

23 Jan 06, 2023

Fast, modular reference implementation and easy training of Semantic Segmentation algorithms in PyTorch.

TorchSeg This project aims at providing a fast, modular reference implementation for semantic segmentation models using PyTorch. Highlights Modular De

1.4k Jan 02, 2023

Official Implementation of SWAD (NeurIPS 2021)

SWAD: Domain Generalization by Seeking Flat Minima (NeurIPS'21) Official PyTorch implementation of SWAD: Domain Generalization by Seeking Flat Minima.

97 Dec 20, 2022

Contrastive Learning for Metagenomic Binning

CLMB A simple framework for CLMB - a novel deep Contrastive Learningfor Metagenomic Binning Created by Pengfei Zhang, senior of Department of Computer

1 Sep 14, 2022

[ WSDM '22 ] On Sampling Collaborative Filtering Datasets

On Sampling Collaborative Filtering Datasets This repository contains the implementation of many popular sampling strategies, along with various expli

17 Dec 08, 2022

Degree-Quant: Quantization-Aware Training for Graph Neural Networks.

Degree-Quant This repo provides a clean re-implementation of the code associated with the paper Degree-Quant: Quantization-Aware Training for Graph Ne

35 Oct 07, 2022

OptaPlanner wrappers for Python. Currently significantly slower than OptaPlanner in Java or Kotlin.

OptaPy is an AI constraint solver for Python to optimize the Vehicle Routing Problem, Employee Rostering, Maintenance Scheduling, Task Assignment, School Timetabling, Cloud Optimization, Conference S

211 Jan 02, 2023

JAX + dataclasses

jax_dataclasses jax_dataclasses provides a wrapper around dataclasses.dataclass for use in JAX, which enables automatic support for: Pytree registrati

35 Dec 21, 2022

Code for the paper: Learning Adversarially Robust Representations via Worst-Case Mutual Information Maximization (https://arxiv.org/abs/2002.11798)

Representation Robustness Evaluations Our implementation is based on code from MadryLab's robustness package and Devon Hjelm's Deep InfoMax. For all t

19 Dec 07, 2022

Using OpenAI's CLIP to upscale and enhance images

Related tags

Overview

CLIP Upscaler and Enhancer

Sample Results

How it works

Owner

Tripp Lyons

Pyramid Pooling Transformer for Scene Understanding

Supervised 3D Pre-training on Large-scale 2D Natural Image Datasets for 3D Medical Image Analysis

Python scripts using the Mediapipe models for Halloween.

Fast, modular reference implementation and easy training of Semantic Segmentation algorithms in PyTorch.

Official Implementation of SWAD (NeurIPS 2021)

Contrastive Learning for Metagenomic Binning

[ WSDM '22 ] On Sampling Collaborative Filtering Datasets

Degree-Quant: Quantization-Aware Training for Graph Neural Networks.

OptaPlanner wrappers for Python. Currently significantly slower than OptaPlanner in Java or Kotlin.

JAX + dataclasses

Code for the paper: Learning Adversarially Robust Representations via Worst-Case Mutual Information Maximization (https://arxiv.org/abs/2002.11798)

CAMoE + Dual SoftMax Loss (DSL): Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss

Repository for open research on optimizers.

Repository of 3D Object Detection with Pointformer (CVPR2021)

FEDn is an open-source, modular and ML-framework agnostic framework for Federated Machine Learning

Tree-based Search Graph for Approximate Nearest Neighbor Search

Node-level Graph Regression with Deep Gaussian Process Models

Distance correlation and related E-statistics in Python

Myia prototyping

Open-AI's DALL-E for large scale training in mesh-tensorflow.