FS2KToolbox

FS2K Dataset

Towards the translation between Face <--> Sketch.

Download (photo+sketch+annotation): Google-drive, Baidu-disk, pw: FS2K.

For more details about the FS2K dataset, please visit this repo.

Put the source frames and result images as follows:

FS2K_PROJ_EVAL
├── photo
│       ├── photo1
│       ├── photo2
│       └── photo3
├── sketch
│       ├── sketch1
│       ├── sketch2
│       └── sketch3
├── I2S
│       ├── results_method1
│       ├── results_method2
│       └── ...
├── S2I
│       ├── results_method1
│       ├── results_method2
│       └── ...
├── anno_test.json
├── anno_train.json

Evaluation

Metric: SCOOT (designed for sketch evaluation) and SSIM.
Env: MATLAB (tested with MATLAB R2020b)
Run eval_FSS_results.m for testing.
Output: two excel files for saving SCOOT and SSIM scores of all methods: overall_scoot, scores_of_facial_parts.

Reference

@aticle{Fan2021FS2K,
  title={Deep Facial Synthesis: A New Challenge},
  author={Deng-Ping, Fan and Ziling, Huang and Peng, Zheng and Hong, Liu and Xuebin, Qin and Luc, Van Gool},
  journal={arXiv},
  year={2021}
}

@article{Fan2019ScootAP,
  title={Scoot: A Perceptual Metric for Facial Sketches},
  author={Deng-Ping Fan and Shengchuan Zhang and Yu-Huan Wu and Yun Liu and Ming-Ming Cheng and Bo Ren and Paul L. Rosin and Rongrong Ji},
  journal={2019 IEEE/CVF International Conference on Computer Vision (ICCV)},
  year={2019},
  pages={5611-5621}
}

@article{Wang2004ImageQA,
  title={Image quality assessment: from error visibility to structural similarity},
  author={Zhou Wang and Alan Conrad Bovik and Hamid R. Sheikh and Eero P. Simoncelli},
  journal={IEEE Transactions on Image Processing},
  year={2004},
  volume={13},
  pages={600-612}
}

FS2KToolbox FS2K Dataset Towards the translation between Face

Related tags

Overview

FS2KToolbox

FS2K Dataset

Evaluation

Reference

Owner

Deng-Ping Fan

Planar Prior Assisted PatchMatch Multi-View Stereo

Code & Models for Temporal Segment Networks (TSN) in ECCV 2016

Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weather

pix2pix in tensorflow.js

Deep Convolutional Generative Adversarial Networks

Code in conjunction with the publication 'Contrastive Representation Learning for Hand Shape Estimation'

Repository for "Toward Practical Monocular Indoor Depth Estimation" (CVPR 2022)

Generative Exploration and Exploitation - This is an improved version of GENE.

Pytorch Implementation of Neural Analysis and Synthesis: Reconstructing Speech from Self-Supervised Representations

Implementation for Shape from Polarization for Complex Scenes in the Wild

[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining

The Deep Learning with Julia book, using Flux.jl.

[ WSDM '22 ] On Sampling Collaborative Filtering Datasets

A customisable game where you have to quickly click on black tiles in order of appearance while avoiding clicking on white squares.

Repo for the Video Person Clustering dataset, and code for the associated paper

NaijaSenti is an open-source sentiment and emotion corpora for four major Nigerian languages

LEAP: Learning Articulated Occupancy of People

Code + pre-trained models for the paper Keeping Your Eye on the Ball Trajectory Attention in Video Transformers

Easy-to-use library to boost AI inference leveraging state-of-the-art optimization techniques.

[CVPR 2021] A Peek Into the Reasoning of Neural Networks: Interpreting with Structural Visual Concepts