Instructions to use timm/vit_pe_lang_large_patch14_448.fb with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- timm
How to use timm/vit_pe_lang_large_patch14_448.fb with timm:
import timm model = timm.create_model("hf_hub:timm/vit_pe_lang_large_patch14_448.fb", pretrained=True) - Transformers
How to use timm/vit_pe_lang_large_patch14_448.fb with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="timm/vit_pe_lang_large_patch14_448.fb")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("timm/vit_pe_lang_large_patch14_448.fb", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add pipeline tag and Github link to metadata
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,20 +1,22 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
tags:
|
| 3 |
- image-feature-extraction
|
| 4 |
- timm
|
| 5 |
- transformers
|
| 6 |
-
|
| 7 |
-
|
| 8 |
---
|
|
|
|
| 9 |
# Model Details
|
| 10 |
|
| 11 |
This is a `timm` remapped, image encoder only variant of the original weights.
|
| 12 |
|
| 13 |
-
[\[
|
| 14 |
-
[\[
|
| 15 |
|
| 16 |
-
Perception Encoder (PE) is a state-of-the-art encoder for image and video understanding trained via simple vision-language learning. It was introduced in "[Perception Encoder: The best visual embeddings
|
| 17 |
-
are not at the output of the network](https://ai.meta.com/research/publications/perception-encoder-the-best-visual-embeddings-are-not-at-the-output-of-the-network/)".
|
| 18 |
|
| 19 |
**Model Developer**: Meta
|
| 20 |
|
|
@@ -60,5 +62,4 @@ If you find our code useful for your research, please consider citing:
|
|
| 60 |
author={Jang Hyun Cho and Andrea Madotto and Effrosyni Mavroudi and Triantafyllos Afouras and Tushar Nagarajan and Muhammad Maaz and Yale Song and Tengyu Ma and Shuming Hu and Hanoona Rasheed and Peize Sun and Po-Yao Huang and Daniel Bolya and Suyog Jain and Miguel Martin and Huiyu Wang and Nikhila Ravi and Shashank Jain and Temmy Stark and Shane Moon and Babak Damavandi and Vivian Lee and Andrew Westbury and Salman Khan and Philipp Kr\"{a}henb\"{u}hl and Piotr Doll{\'a}r and Lorenzo Torresani and Kristen Grauman and Christoph Feichtenhofer},
|
| 61 |
journal={arXiv},
|
| 62 |
year={2025}
|
| 63 |
-
}
|
| 64 |
-
|
|
|
|
| 1 |
---
|
| 2 |
+
library_name: timm
|
| 3 |
+
license: apache-2.0
|
| 4 |
tags:
|
| 5 |
- image-feature-extraction
|
| 6 |
- timm
|
| 7 |
- transformers
|
| 8 |
+
pipeline_tag: image-feature-extraction
|
| 9 |
+
github: https://github.com/facebookresearch/perception_models/
|
| 10 |
---
|
| 11 |
+
|
| 12 |
# Model Details
|
| 13 |
|
| 14 |
This is a `timm` remapped, image encoder only variant of the original weights.
|
| 15 |
|
| 16 |
+
[\\[\ud83d\udcc3 Tech Report\\]](https://arxiv.org/abs/2504.13181)
|
| 17 |
+
[\\[\ud83d\udcc2 Github\\]](https://github.com/facebookresearch/perception_models/)
|
| 18 |
|
| 19 |
+
Perception Encoder (PE) is a state-of-the-art encoder for image and video understanding trained via simple vision-language learning. It was introduced in "[Perception Encoder: The best visual embeddings are not at the output of the network](https://ai.meta.com/research/publications/perception-encoder-the-best-visual-embeddings-are-not-at-the-output-of-the-network/)".
|
|
|
|
| 20 |
|
| 21 |
**Model Developer**: Meta
|
| 22 |
|
|
|
|
| 62 |
author={Jang Hyun Cho and Andrea Madotto and Effrosyni Mavroudi and Triantafyllos Afouras and Tushar Nagarajan and Muhammad Maaz and Yale Song and Tengyu Ma and Shuming Hu and Hanoona Rasheed and Peize Sun and Po-Yao Huang and Daniel Bolya and Suyog Jain and Miguel Martin and Huiyu Wang and Nikhila Ravi and Shashank Jain and Temmy Stark and Shane Moon and Babak Damavandi and Vivian Lee and Andrew Westbury and Salman Khan and Philipp Kr\"{a}henb\"{u}hl and Piotr Doll{\'a}r and Lorenzo Torresani and Kristen Grauman and Christoph Feichtenhofer},
|
| 63 |
journal={arXiv},
|
| 64 |
year={2025}
|
| 65 |
+
}
|
|
|