Awesome Watermarking

This repository contains a curated list of awesome watermarking, steganography and other related works in the field of intelligence property protection.

Table of Contents

• Survey
• Text Watermarking
• Image Watermarking
• Model Watermarking
• Prompt Watermarking
• Model Fingerprint
• Others

Survey

• A Brief Survey on Deep Learning Based Data Hiding

  • Chaoning Zhang, Chenguo Lin, Philipp Benz, Kejiang Chen, Weiming Zhang, In So Kweon
  • 2021 Paper URL

• A Comprehensive Review on Digital Image Watermarking

  • Shweta Wadhera, Deepa Kamra, Ankit Rajpal, Aruna Jain, Vishal Jain
  • 2021 Paper URL

• A Brief Yet In-Depth Survey of Deep Learning-Based Image Watermarking

  • Xin Zhong, Arjon Das, Fahad Alrasheedi, Abdullah Tanvir
  • 2023 Paper URL

• A Survey on Detection of LLMs-Generated Content

  • Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
  • 2023 Paper URL

• A Survey of Text Watermarking in the Era of Large Language Models

  • Aiwei Liu, Leyi Pan, Yijian Lu, Jingjing Li, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu
  • 2024 Paper URL

• Double-I Watermark: Protecting Model Copyright for LLM Fine-tuning

  • Shen Li, Liuyi Yao, Jinyang Gao, Lan Zhang, Yaliang Li
  • 2024 Paper URL

• Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models

  • Zhiwei He, Binglin Zhou, Hongkun Hao, Aiwei Liu, Xing Wang, Zhaopeng Tu, Zhuosheng Zhang, Rui Wang
  • 2024 Paper URL

Text Watermarking

• Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hiding

  • Sahar Abdelnabi, Mario Fritz
  • 2020 Paper URL

• A novel watermarking framework for intellectual property protection of NLG APIs

  • Mingjie Li, Hanzhou Wu, Xinpeng Zhang
  • 2021 Paper URL

• Semantic-Preserving Linguistic Steganography by Pivot Translation and Semantic-Aware Bins Coding

  • Tianyu Yang, Hanzhou Wu, Biao Yi, Guorui Feng, Xinpeng Zhang
  • 2022 Paper URL

• Watermarking Pre-trained Language Models with Backdooring

  • Chenxi Gu, Chengsong Huang, Xiaoqing Zheng, Kai-Wei Chang, Cho-Jui Hsieh
  • 2022 Paper URL

• A Watermark for Large Language Models

  • John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, Tom Goldstein
  • 2023 ICML Paper URL

• Protecting Language Generation Models via Invisible Watermarking

  • Xuandong Zhao, Yu-Xiang Wang, Lei Li
  • 2023 ICML Paper URL

• REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Models

  • Ruisi Zhang, Shehzeen Samarah Hussain, Paarth Neekhara, Farinaz Koushanfar
  • 2023 Paper URL

• Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy

  • Yu Fu, Deyi Xiong, Yue Dong
  • 2023 Paper URL

• Functional Invariants to Watermark Large Transformers

  • Fernandez Pierre, Couairon Guillaume, Furon Teddy, Douze Matthijs
  • 2023 Paper URL

• Towards Codable Watermarking for Injecting Multi-bit Information to LLM

  • Lean Wang, Wenkai Yang, Deli Chen, Hao Zhou, Yankai Lin, Fandong Meng, Jie Zhou, Xu Sun
  • 2023 Paper URL

• On the Reliability of Watermarks for Large Language Models

  • John Kirchenbauer, Jonas Geiping, Yuxin Wen, Manli Shu, Khalid Saifullah, Kezhi Kong, Kasun Fernando, Aniruddha Saha, Micah Goldblum, Tom Goldstein
  • 2023 Paper URL

• On the Learnability of Watermarks for Language Models

  • Chenchen Gu, Xiang Lisa Li, Percy Liang, Tatsunori Hashimoto
  • 2023 Paper URL

• I Know You Did Not Write That! A Sampling Based Watermarking Method for Identifying Machine Generated Text

  • Kaan Efe Keleş, Ömer Kaan Gürbüz, Mucahid Kutlu
  • 2023 arXiv Paper URL

• Optimizing watermarks for large language models

  • Bram Wouters
  • 2023 arXiv Paper URL

• A Semantic Invariant Robust Watermark for Large Language Models

  • Aiwei Liu, Leyi Pan, Xuming Hu, Shiao Meng, Lijie Wen
  • 2024 ICLR Paper URL

• Unbiased Watermark for Large Language Models

  • Zhengmian Hu, Lichang Chen, Xidong Wu, Yihan Wu, Hongyang Zhang, Heng Huang
  • 2024 ICLR Paper URL

• Watermark Stealing in Large Language Models

  • Nikola Jovanović, Robin Staab, Martin Vechev
  • 2024 Paper URL

• An Unforgeable Publicly Verifiable Watermark for Large Language Models

  • Aiwei Liu, Leyi Pan, Xuming Hu, Shu'ang Li, Lijie Wen, Irwin King, Philip S. Yu
  • 2024 ICLR Paper URL

• Adaptive Text Watermark for Large Language Models

  • Yepeng Liu, Yuheng Bu
  • 2024 Paper URL

• RobWE: Robust Watermark Embedding for Personalized Federated Learning Model Ownership Protection

  • Yang Xu, Yunlin Tan, Cheng Zhang, Kai Chi, Peng Sun, Wenyuan Yang, Ju Ren, Hongbo Jiang, Yaoxue Zhang
  • 2024 Paper URL

• Duwak: Dual Watermarks in Large Language Models

  • Chaoyi Zhu, Jeroen Galjaard, Pin-Yu Chen, Lydia Y. Chen
  • 2024 Paper URL

• Waterfall: Framework for Robust and Scalable Text Watermarking

  • Gregory Kang Ruey Lau, Xinyuan Niu, Hieu Dao, Jiangwei Chen, Chuan-Sheng Foo, Bryan Kian Hsiang Low
  • 2024 Paper URL

• Less is More: Sparse Watermarking in LLMs with Enhanced Text Quality

  • Duy C. Hoang, Hung T. Q. Le, Rui Chu, Ping Li, Weijie Zhao, Yingjie Lao, Khoa D. Doan
  • 2024 Paper URL

Image Watermarking

• HiDDeN: Hiding Data With Deep Networks

  • Jiren Zhu, Russell Kaplan, Justin Johnson, Li Fei-Fei
  • 2018 ECCV Paper URL

• StegaStamp: Invisible Hyperlinks in Physical Photographs

  • Matthew Tancik, Ben Mildenhall, Ren Ng
  • 2020 CVPR Paper URL

• Robust High-Capacity Watermarking Over Online Social Network Shared Images

  • Weiwei Sun; Jiantao Zhou; Yuanman Li; Ming Cheung; James She
  • 2020 TCSVT Paper URL

• HiNet: Deep Image Hiding by Invertible Network

  • Junpeng Jing1, Xin Deng1, Mai Xu2, Jianyi Wang2, Zhenyu Guan1
  • 2021 ICCV Paper URL

• Certified Neural Network Watermarks with Randomized Smoothing

  • Arpit Bansal, Ping-yeh Chiang, Michael Curry, Rajiv Jain, Curtis Wigington, Varun Manjunatha, John P Dickerson, Tom Goldstein
  • 2022 ICML Paper URL

• A Watermarking Framework for Detecting Art Theft Mimicry in Text-to-Image Models

  • Ge Luo, Junqiang Huang, Manman Zhang, Zhenxing Qian, Sheng Li, Xinpeng Zhang
  • 2023 Paper URL

• EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection

  • Xuanyu Zhang, Runyi Li, Jiwen Yu, Youmin Xu, Weiqi Li, Jian Zhang
  • 2023 Paper URL

• PTW: Pivotal Tuning Watermarking for Pre-Trained Image Generators

  • Nils Lukas, Florian Kerschbaum
  • 2023 USENIX Paper URL

• Securing Deep Generative Models with Universal Adversarial Signature

  • Yu Zeng, Mo Zhou, Yuan Xue, Vishal M. Patel
  • 2023 Paper URL

• Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust

  • Yuxin Wen, John Kirchenbauer, Jonas Geiping, Tom Goldstein
  • 2023 NeurIPS Paper URL

• TrustMark: Universal Watermarking for Arbitrary Resolution Images

  • Tu Bui, Shruti Agarwal, John Collomosse
  • 2023 arXiv Paper URL

• RoSteALS: Robust Steganography using Autoencoder Latent Space

  • Tu Bui, Shruti Agarwal, Ning Yu, John Collomosse
  • 2023 CVPR Workshop on Media Forensics Paper URL

• A Recipe for Watermarking Diffusion Models

  • Yunqing Zhao, Tianyu Pang, Chao Du, Xiao Yang, Ngai-Man Cheung, Min Lin
  • 2023 Paper URL

• Robust Image Watermarking using Stable Diffusion

  • Lijun Zhang, Xiao Liu, Antoni Viros Martin, Cindy Xiong Bearfield, Yuriy Brun, Hui Guan
  • 2024 arXiv Paper URL

• Deep neural networks watermark via universal deep hiding and metric learning

  • Zhicheng Ye, Xinpeng Zhang, Guorui Feng
  • 2024 Paper URL

• RobWE: Robust Watermark Embedding for Personalized Federated Learning Model Ownership Protectio

  • Yang Xu, Yunlin Tan, Cheng Zhang, Kai Chi, Peng Sun, Wenyuan Yang, Ju Ren, Hongbo Jiang, Yaoxue Zhang
  • 2024 Paper URL

• Deep Learning-based Text-in-Image Watermarking

  • Bishwa Karki, Chun-Hua Tsai, Pei-Chi Huang, Xin Zhong
  • 2024 Paper URL

Model Watermarking

• Embedding Watermarks into Deep Neural Networks

  • Yusuke Uchida, Yuki Nagai, Shigeyuki Sakazawa, Shin'ichi Satoh
  • 2017 ICMR Paper URL

• Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooring

  • Yossi Adi, Carsten Baum, Moustapha Cisse, Benny Pinkas, Joseph Keshet
  • 2018 USENIX Paper URL

• DeepSigns: An End-to-End Watermarking Framework for Ownership Protection of Deep Neural Networks

  • PictureBita Darvish Rouhani, PictureHuili Chen, PictureFarinaz Koushanfar
  • 2019 ASPLOS Paper URL

• Passport-aware Normalization for Deep Model Protection

  • Jie Zhang, Dongdong Chen, Jing Liao, Weiming Zhang, Gang Hua, Nenghai Yu
  • 2020 NeurIPS Paper URL

• Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data

  • Ning Yu, Vladislav Skripniuk, Sahar Abdelnabi, Mario Fritz
  • 2021 ICCV Paper URL

• Non-Transferable Learning: A New Approach for Model Ownership Verification and Applicability Authorization

  • Lixu Wang, Shichao Xu, Ruiqi Xu, Xiao Wang, Qi Zhu
  • 2022 ICLR Paper URL

• Undetectable Watermarks for Language Models

  • Miranda Christ, Sam Gunn, Or Zamir
  • 2023 Paper URL

• Three Bricks to Consolidate Watermarks for Large Language Models

  • Pierre Fernandez, Antoine Chaffin, Karim Tit, Vivien Chappelier, Teddy Furon
  • 2023 WIFS Paper URL

• Towards Codable Watermarking for Injecting Multi-bits Information to LLMs

  • Lean Wang, Wenkai Yang, Deli Chen, Hao Zhou, Yankai Lin, Fandong Meng, Jie Zhou, Xu Sun
  • 2024 ICLR Paper URL

• Multi-Bit Distortion-Free Watermarking for Large Language Models

  • Massieh Kordi Boroujeny, Ya Jiang, Kai Zeng, Brian Mark
  • 2024 Paper URL

• Safeguarding Transformer Models Against Model Stealing in Edge Deployment

  • Qinfeng Li, Zhiqiang Shen, Zhenghan Qin, Yangfan Xie, Xuhong Zhang, Tianyu Du, Jianwei Yin
  • 2024 Paper URL

• ProFLingo: A Fingerprinting-based Copyright Protection Scheme for Large Language Models

  • Heng Jin, Chaoyu Zhang, Shanghao Shi, Wenjing Lou, Y. Thomas Hou
  • 2024 Paper URL

• A Watermark for Large Language Models

  • John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, Tom Goldstein
  • 2023 ICML Paper URL

• Where Did I Come From? Origin Attribution of AI-Generated Images

  • Zhenting Wang, Chen Chen, Yi Zeng, Lingjuan Lyu, Shiqing Ma
  • 2024 NeurIPS Paper URL

• Unbiased Watermark for Large Language Models

  • Zhengmian Hu, Lichang Chen, Xidong Wu, Yihan Wu, Hongyang Zhang, Heng Huang
  • 2024 ICLR Paper URL

• A Semantic Invariant Robust Watermark for Large Language Models

  • Aiwei Liu, Leyi Pan, Xuming Hu, Shiao Meng, Lijie Wen
  • 2024 ICLR Paper URL

• An Unforgeable Publicly Verifiable Watermark for Large Language Models

  • Aiwei Liu, Leyi Pan, Xuming Hu, Shu'ang Li, Lijie Wen, Irwin King, Philip S. Yu
  • 2024 ICLR Paper URL

• A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models

  • Yihan Wu, Zhengmian Hu, Junfeng Guo, Hongyang Zhang, Heng Huang
  • 2024 ICML Paper URL

• Token-Specific Watermarking with Enhanced Detectability and Semantic Coherence for Large Language Models

  • Mingjia Huo, Sai Ashish Somayajula, Youwei Liang, Ruisi Zhang, Farinaz Koushanfar, Pengtao Xie
  • 2024 ICML Paper URL

• Adaptive Text Watermark for Large Language Models

  • Yepeng Liu, Yuheng Bu
  • 2024 ICML Paper URL

• How to Trace Latent Generative Model Generated Images without Artificial Watermark?

  • Zhenting Wang, Vikash Sehwag, Chen Chen, Lingjuan Lyu, Dimitris N. Metaxas, Shiqing Ma
  • 2024 ICML Paper URL

• Safe-SD: Safe and Traceable Stable Diffusion with Text Prompt Trigger for Invisible Generative Watermarking

  • Zhiyuan Ma, Guoli Jia, Biqing Qi, Bowen Zhou
  • 2024 arXiv Paper URL

• WatME: Towards Lossless Watermarking Through Lexical Redundancy

  • Liang Chen, Yatao Bian, Yang Deng, Deng Cai, Shuaiyi Li, Peilin Zhao, Kam-fai Wong
  • 2024 ACL Paper URL

• Multi-bit Watermark for Large Language Models via Position Allocation

  • KiYoon Yoo, Wonhyuk Ahn, Nojun Kwak
  • 2024 ACL Paper URL

• Permute-and-Flip: An optimally robust and watermarkable decoder for LLMs

  • Xuandong Zhao, Lei Li, Yu-Xiang Wang
  • 2024 Paper URL

• A Watermark for Low-entropy and Unbiased Generation in Large Language Models

  • Minjia Mao, Dongjun Wei, Zeyu Chen, Xiao Fang, Michael Chau
  • 2024 Paper URL

• PostMark: A Robust Blackbox Watermark for Large Language Models

  • Yapei Chang, Kalpesh Krishna, Amir Houmansadr, John Wieting, Mohit Iyyer
  • 2024 Paper URL

• MarkLLM: An Open-Source Toolkit for LLM Watermarking

  • Leyi Pan, Aiwei Liu, Zhiwei He, Zitian Gao, Xuandong Zhao, Yijian Lu, Binglin Zhou, Shuliang Liu, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu
  • 2024 Paper URL

• A Watermark for Black-Box Language Models

  • Dara Bahri, John Wieting, Dana Alon, Donald Metzler
  • 2024 Paper URL

• Scalable Watermarking For Identifying Large Language Model Outputs

  • Sumanth Dathathri, Abigail See, Sumedh Ghaisas, Po-Sen Huang, Rob McAdam, Johannes Welbl, Vandana Bachani, Alex Kaskasoli, Robert Stanforth, Tatiana Matejovicova, Jamie Hayes, Nidhi Vyas, Majd Al Merey, Jonah Brown-Cohen, Rudy Bunel, Borja Balle, Taylan Cemgil, Zahra Ahmed, Kitty Stacpoole, Ilia Shumailov, Ciprian Baetu, Sven Gowal, Demis Hassabis, Pushmeet Kohli
  • 2024 Nature Paper URL

Prompt Watermarking

• Are You Copying My Prompt? Protecting the Copyright of Vision Prompt for VPaaS via Watermark

  • Huali Ren, Anli Yan, Chong-zhi Gao, Hongyang Yan, Zhenxin Zhang, Jin Li
  • 2024 Paper URL

• Why Are My Prompts Leaked? Unraveling Prompt Extraction Threats in Customized Large Language Models

  • Zi Liang, Haibo Hu, Qingqing Ye, Yaxin Xiao, Haoyang Li
  • 2024 Paper URL

Model Fingerprint

• Deep Neural Network Fingerprinting by Conferrable Adversarial Examples

  • Nils Lukas, Yuxuan Zhang, Florian Kerschbaum
  • 2021 ICLR Paper URL

• Deepfake Fingerprint Detection Model Intellectual Property Protection via Ridge Texture Enhancement

  • Chengsheng Yuan, Qiang Guo, Zhili Zhou, Zhangjie Fu, Zhihua Xia
  • 2023 Paper URL

• ManiFPT: Defining and Analyzing Fingerprints of Generative Models

  • Hae Jin Song, Mahyar Khayatkhoei, Wael AbdAlmageed
  • 2024 CVPR Paper URL

• Inversion-guided Defense: Detecting Model Stealing Attacks by Output Inverting

  • Shuai Zhou, Tianqing Zhu, Dayong Ye, Wanlei Zhou, Wei Zhao
  • 2024 TIFS Paper URL

• Instructional Fingerprinting of Large Language Models

  • Jiashu Xu, Fei Wang, Mingyu Derek Ma, Pang Wei Koh, Chaowei Xiao, Muhao Chen
  • 2024 Paper URL

• Human-Readable Fingerprint for Large Language Models

  • Boyi Zeng, Chenghu Zhou, Xinbing Wang, Zhouhan Lin
  • 2024 Paper URL

• Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRA

  • Weitao Feng, Wenbo Zhou, Jiyan He, Jie Zhang, Tianyi Wei, Guanlin Li, Tianwei Zhang, Weiming Zhang, Nenghai Yu
  • 2024 ICML Paper URL

• Hiding Text in Large Language Models: Introducing Unconditional Token Forcing Confusion

  • Jakub Hoscilowicz, Pawel Popiolek, Jan Rudkowski, Jedrzej Bieniasz, Artur Janicki
  • 2024 Paper URL

• LLMmap: Fingerprinting For Large Language Models

  • Dario Pasquini, Evgenios M. Kornaropoulos, Giuseppe Ateniese
  • 2024 Paper URL

• FP-VEC: Fingerprinting Large Language Models via Efficient Vector Addition

  • Zhenhua Xu, Wenpeng Xing, Zhebo Wang, Chang Hu, Chen Jie, Meng Han
  • 2024 Paper URL

Others

• Neural Lineage
  • Runpeng Yu, Xinchao Wang
  • 2024 CVPR Paper URL