Existing text-to-image customization methods (i.e., subject-driven generation) face a fundamental challenge due to the entangled influence of visual and textual conditions. This inherent conflict forces a trade-off between subject fidelity and textual controllability, preventing simultaneous optimization of both objectives.We present RealCustom to disentangle subject similarity from text controllability and thereby allows both to be optimized simultaneously without conflicts. The core idea of RealCustom is to represent given subjects as real words that can be seamlessly integrated with given texts, and further leveraging the relevance between real words and image regions to disentangle visual condition from text condition.
⚡️ Quick Start
🔧 Requirements and Installation
Install the requirements
bash envs/init.sh
✍️ Inference
bash inference/inference_single_image.sh
🌟 Gradio Demo
python inference/app.py
Citation
If you find this project useful for your research, please consider citing our papers:
@inproceedings{huang2024realcustom,
title={RealCustom: narrowing real text word for real-time open-domain text-to-image customization},
author={Huang, Mengqi and Mao, Zhendong and Liu, Mingcong and He, Qian and Zhang, Yongdong},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={7476--7485},
year={2024}
}
@article{mao2024realcustom++,
title={Realcustom++: Representing images as real-word for real-time customization},
author={Mao, Zhendong and Huang, Mengqi and Ding, Fei and Liu, Mingcong and He, Qian and Zhang, Yongdong},
journal={arXiv preprint arXiv:2408.09744},
year={2024}
}
Runs of bytedance-research RealCustom on huggingface.co
0
Total runs
0
24-hour runs
0
3-day runs
0
7-day runs
0
30-day runs
More Information About RealCustom huggingface.co Model
RealCustom huggingface.co is an AI model on huggingface.co that provides RealCustom's model effect (), which can be used instantly with this bytedance-research RealCustom model. huggingface.co supports a free trial of the RealCustom model, and also provides paid use of the RealCustom. Support call RealCustom model through api, including Node.js, Python, http.
RealCustom huggingface.co is an online trial and call api platform, which integrates RealCustom's modeling effects, including api services, and provides a free online trial of RealCustom, you can try RealCustom online for free by clicking the link below.
bytedance-research RealCustom online free url in huggingface.co:
RealCustom is an open source model from GitHub that offers a free installation service, and any user can find RealCustom on GitHub to install. At the same time, huggingface.co provides the effect of RealCustom install, users can directly use RealCustom installed effect in huggingface.co for debugging and trial. It also supports api for free installation.