Skip to content

fei-aiart/sRender

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

sRender

We provide Pytorch implementation for sRender (i.e. sketch render).

Reference:

Shang, Meimei, Fei Gao *, Xiang Li, Jingjie Zhu, and Lingna Dai. "Bridging Unpaired Facial Photos And Sketches By Line-drawings." In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2010-2014. IEEE, 6-11 June 2021.

[paper@IEEE] [paper@arXiv] [project@github]

Pipeline

Reconstructed sketches

Sketch Reconstruction

left: croquis style; right: charcoal style Reconstructed sketches (a)Sketches ; (b)Generated Line-drawings ; (c)Synthesized Sketches

Sketch Generation (from photos)

left: croquis style; right: charcoal style Generated sketches (a)Photos ; (b)Generated Line-drawings ; (c)Synthesized Sketches

Comparison

  • Croquis sketches generated by our sRender and unpaired I2I translation methods

compare with SOTA

Train and test

  • charcoal_style for systhesising charcoal style images,it contains sRender w/o Lstr for model without stroke_loss and sRender for model with stroke_loss correspodingly
  • croquis_style for systhesising croquis style images,it contains sRenderPix2Pix, sRender w/o Lstr and sRender
  • download dataset gray for charcol_style, binary for croquis_style
  • download pretrain model and put them in ./checkpoints for test
  • for model with stroke_loss, you should download stroke_model and specify model root in ./models/pix2pixHD_model for net_c.load_state_dict
  • you can modify options/base_option to specify --dataroot, then run train.py or test.py

Dataset

Pretrained models

Results

  • Our synthesis result for croquis and charcoal style can be downloaded from Goole Drive

Citation

bib

@inproceedings{shang2021bridging,
  title={Bridging Unpaired Facial Photos And Sketches By Line-drawings},
  author={Shang, Meimei and Gao, Fei and Li, Xiang and Zhu, Jingjie and Dai, Lingna},
  booktitle={ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  pages={2010--2014},
  year={2021},
  organization={IEEE}
}

Acknowledgments