Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

CLIP does not have explicit OCR support, but it does somewhat coincidentally have a slight understanding of text. This is explained by training captions containing (some of) the text that is in the image.


I think the SigLIP models' dataset (WebLi) includes OCRed things too, so they have very good text understanding. I tested a bunch of things for my own meme search engine.





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: