dejanseo commited on
Commit
5477ebb
Β·
verified Β·
1 Parent(s): fb284bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +170 -54
README.md CHANGED
@@ -14,59 +14,175 @@ tags:
14
 
15
  Following is the complete list of machine learning models in Chrome many of which are on your device. They are located in your User Data folder and you can easily check to see which ones you have as they are all in numbered folders.
16
 
17
- 0. Unknown Optimization – Used when the optimization target is not specified.
18
- 1. Painful Page Load Prevention – Triggers optimizations when page load times are expected to cause user frustration.
19
- 2. Language Detector – Optimizes for detecting the language of the page content.
20
- 3. Page Topics Classifier – Analyzes and classifies the topics present on a page.
21
- 4. New Tab User Targeting – Segments users based on their interaction with new tab pages.
22
- 5. Content Sharing Optimizer – Targets users who frequently share content.
23
- 6. Voice Interaction Optimizer – Segments users based on voice interaction with the web.
24
- 7. Model Validation – Ensures models are working as intended during execution.
25
- 8. Page Entities Classifier – Detects and classifies entities (e.g., people, places, things) on a page.
26
- 9. Notification Permission Predictor – Predicts whether a user is likely to allow notification permissions.
27
- 10. Dummy Data Collection – Used for running experiments and collecting data client-side.
28
- 11. Android Chrome Start Page Targeting – Segments users who frequently use Chrome’s Android start page.
29
- 12. Query Tiles Targeting – Segments users interacting with query tiles.
30
- 13. Page Visibility Detector – Optimizes based on the visibility of a page’s content.
31
- 14. Page Topics Classifier V2 – A refined version of the page topics classifier.
32
- 15. Low Engagement User Targeting – Segments users with low engagement on Chrome.
33
- 16. Feed User Targeting – Targets users who prefer using content feeds.
34
- 17. Price Tracking Action – Determines if price tracking should be shown as a contextual action.
35
- 18. Text Classifier – Optimizes for smart text selection and entity extraction.
36
- 19. Geolocation Permission Predictor – Predicts if a user will allow geolocation permissions.
37
- 20. Shopping User Targeting – Segments users interested in shopping.
38
- 21. Android Chrome Start Page Targeting V2 – Updated targeting for Chrome’s Android start page users.
39
- 22. Search User Targeting – Segments users who frequently use search.
40
- 23. Omnibox Tail Suggestions – Optimizes on-device suggestions in the Chrome Omnibox.
41
- 24. Client-Side Phishing Protection – Protects against phishing attacks by analyzing client-side data.
42
- 25. Omnibox URL Scoring – Optimizes URL suggestions in the Chrome Omnibox.
43
- 26. Device Switcher Targeting – Targets users who switch between devices.
44
- 27. Adaptive Toolbar Optimizer – Optimizes the toolbar based on user behavior.
45
- 28. Tablet Productivity User Targeting – Segments tablet users who focus on productivity tasks.
46
- 29. Phishing Image Protection – Embeds images to protect against phishing attacks.
47
- 30. History Clusters Ranking – Ranks history clusters for the New Tab Page module.
48
- 31. Web App Install Promotion – Promotes web app installations.
49
- 32. Text Embedder – Embeds text for efficient storage and retrieval.
50
- 33. Visual Search Classifier – Classifies and extracts search-related images from a webpage.
51
- 34. Bottom Toolbar Targeting – Segments users based on bottom toolbar interaction.
52
- 35. Autofill Field Classifier – Optimizes autofill suggestions by classifying form fields.
53
- 36. iOS Module Ranker – Ranks modules on the iOS start page.
54
- 37. Desktop NTP Module Optimizer – Determines which modules to display on a desktop’s New Tab Page.
55
- 38. Preloading Heuristics – Optimizes preloading of links based on speculation rules.
56
- 39. Text Safety Detector – Ensures the safety of text content on a page.
57
- 40. Android Home Module Ranker – Ranks home modules for Android users.
58
- 41. Compose On-Device Optimizer – Supports running the Compose feature on devices.
59
- 42. Passage Embedder – Embeds passages for retrieval and analysis.
60
- 43. Phrase Segmentation – Breaks up text into meaningful phrases.
61
- 44. Compose Promotion Targeting – Targets users for promoting the Compose feature.
62
- 45. URL Visit Resumption Ranker – Ranks URL visits for features that allow resuming visits.
63
- 46. Camera Background Segmentation – Segments video frames to optimize camera backgrounds.
64
- 47. History Search Optimizer – Optimizes search within browser history.
65
- 48. Prompt API Optimizer – Configures optimizations for the Prompt API.
66
- 49. Metrics Clustering Optimizer – Segments users based on metrics clustering.
67
- 50. Summarize API Optimizer – Configures the API that summarizes content.
68
- 51. Password Manager Form Classifier – Classifies forms to optimize password management.
69
- 52. Suspicious Notification Detection – Detects potentially suspicious notification content.
70
- 53. History Query Intent Optimizer – Classifies the intent behind history queries.
71
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
  Source: [DEJAN](https://dejan.ai/blog/chrome-ai-models/)
 
14
 
15
  Following is the complete list of machine learning models in Chrome many of which are on your device. They are located in your User Data folder and you can easily check to see which ones you have as they are all in numbered folders.
16
 
17
+ // The scenarios for which the optimization guide has models for.
18
+ enum OptimizationTarget {
19
+ reserved 14;
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
 
21
+ OPTIMIZATION_TARGET_UNKNOWN = 0;
22
+
23
+ // Should only be applied when the page load is predicted to be painful.
24
+ OPTIMIZATION_TARGET_PAINFUL_PAGE_LOAD = 1;
25
+
26
+ // Target for supplying the language detection model via the model downloader.
27
+ OPTIMIZATION_TARGET_LANGUAGE_DETECTION = 2;
28
+
29
+ // Target for determining topics present on a page.
30
+ OPTIMIZATION_TARGET_PAGE_TOPICS = 3;
31
+
32
+ // Target for segmentation: New tab page user.
33
+ OPTIMIZATION_TARGET_SEGMENTATION_NEW_TAB = 4;
34
+
35
+ // Target for segmentation: Share user.
36
+ OPTIMIZATION_TARGET_SEGMENTATION_SHARE = 5;
37
+
38
+ // Target for segmentation: Voice user.
39
+ OPTIMIZATION_TARGET_SEGMENTATION_VOICE = 6;
40
+
41
+ // Target for model validation.
42
+ OPTIMIZATION_TARGET_MODEL_VALIDATION = 7;
43
+
44
+ // Target for determining entities present on a page.
45
+ OPTIMIZATION_TARGET_PAGE_ENTITIES = 8;
46
+
47
+ // Target for Chrome Permissions Suggestions Service: Notification permission.
48
+ OPTIMIZATION_TARGET_NOTIFICATION_PERMISSION_PREDICTIONS = 9;
49
+
50
+ // Target that enables data collection on client side for various experiments.
51
+ OPTIMIZATION_TARGET_SEGMENTATION_DUMMY = 10;
52
+
53
+ // Target for segmentation: Chrome Android Start user.
54
+ OPTIMIZATION_TARGET_SEGMENTATION_CHROME_START_ANDROID = 11;
55
+
56
+ // Target for segmentation: Query Tiles user.
57
+ OPTIMIZATION_TARGET_SEGMENTATION_QUERY_TILES = 12;
58
+
59
+ // Target for determining the UI visibility of a page.
60
+ OPTIMIZATION_TARGET_PAGE_VISIBILITY = 13;
61
+
62
+ // Target for determining topics present on a page.
63
+ // TODO(crbug.com/40204121): Remove PAGE_TOPICS in favor of this target.
64
+ OPTIMIZATION_TARGET_PAGE_TOPICS_V2 = 15;
65
+
66
+ // Target for segmentation: Determine users with low engagement with chrome.
67
+ OPTIMIZATION_TARGET_SEGMENTATION_CHROME_LOW_USER_ENGAGEMENT = 16;
68
+
69
+ // Target for segmentation: Determine users who prefer to us
70
+ e Feed.
71
+ OPTIMIZATION_TARGET_SEGMENTATION_FEED_USER = 17;
72
+
73
+ // Target for segmentation: Determine whether price tracking should be shown
74
+ // as a contextual page action.
75
+ OPTIMIZATION_TARGET_CONTEXTUAL_PAGE_ACTION_PRICE_TRACKING = 18;
76
+
77
+ // Target for smart text selection and entity extraction.
78
+ OPTIMIZATION_TARGET_TEXT_CLASSIFIER = 19;
79
+
80
+ // Target for Chrome Permissions Suggestions Service: Geolocation permission.
81
+ OPTIMIZATION_TARGET_GEOLOCATION_PERMISSION_PREDICTIONS = 20;
82
+
83
+ // Target for segmentation: Determine users who are interested in shopping.
84
+ OPTIMIZATION_TARGET_SEGMENTATION_SHOPPING_USER = 21;
85
+
86
+ // Target for segmentation: Chrome Android Start user V2.
87
+ OPTIMIZATION_TARGET_SEGMENTATION_CHROME_START_ANDROID_V2 = 22;
88
+
89
+ // Target for segmentation: Determine users who use search.
90
+ OPTIMIZATION_TARGET_SEGMENTATION_SEARCH_USER = 23;
91
+
92
+ // Target for Omnibox on device tail suggest.
93
+ OPTIMIZATION_TARGET_OMNIBOX_ON_DEVICE_TAIL_SUGGEST = 24;
94
+
95
+ // Target for client side phishing
96
+ OPTIMIZATION_TARGET_CLIENT_SIDE_PHISHING = 25;
97
+
98
+ // Target for Omnibox URL suggestion scoring.
99
+ OPTIMIZATION_TARGET_OMNIBOX_URL_SCORING = 26;
100
+
101
+ // Target for segmentation: Segment of users who switched devices.
102
+ OPTIMIZATION_TARGET_SEGMENTATION_DEVICE_SWITCHER = 27;
103
+
104
+ // Target for segmentation: Adaptive toolbar button.
105
+ OPTIMIZATION_TARGET_SEGMENTATION_ADAPTIVE_TOOLBAR = 28;
106
+
107
+ // Target for segmentation: Determine users who are tabletproductivity users.
108
+ OPTIMIZATION_TARGET_SEGMENTATION_TABLET_PRODUCTIVITY_USER = 29;
109
+
110
+ // Target for client side phishing image embedding model.
111
+ OPTIMIZATION_TARGET_CLIENT_SIDE_PHISHING_IMAGE_EMBEDDER = 30;
112
+
113
+ // Target for ranking clusters that have passed minimal filtering for the New
114
+ // Tab Page History Clusters module.
115
+ OPTIMIZATION_TARGET_NEW_TAB_PAGE_HISTORY_CLUSTERS_MODULE_RANKING = 31;
116
+
117
+ // Target for web app install promotion.
118
+ OPTIMIZATION_TARGET_WEB_APP_INSTALLATION_PROMO = 32;
119
+
120
+ // Target for generic text embedder model.
121
+ OPTIMIZATION_TARGET_TEXT_EMBEDDER = 33;
122
+
123
+ // Target for classifying and extracting search images on web page.
124
+ OPTIMIZATION_TARGET_VISUAL_SEARCH_CLASSIFICATION = 34;
125
+
126
+ // Target for classifying users to target bottom toolbar.
127
+ OPTIMIZATION_TARGET_SEGMENTATION_BOTTOM_TOOLBAR = 35;
128
+
129
+ // Target for Autofill field type classification model.
130
+ OPTIMIZATION_TARGET_AUTOFILL_FIELD_CLASSIFICATION = 36;
131
+
132
+ // Target for ranking ios start page modules.
133
+ OPTIMIZATION_TARGET_SEGMENTATION_IOS_MODULE_RANKER = 37;
134
+
135
+ // Target for segmentation: Determine what modules a user should see on their
136
+ // Desktop New Tab Page.
137
+ OPTIMIZATION_TARGET_SEGMENTATION_DESKTOP_NTP_MODULE = 38;
138
+
139
+ // Target for predicting candidate links for speculation-rule based
140
+ // preloading.
141
+ OPTIMIZATION_TARGET_PRELOADING_HEURISTICS = 39;
142
+
143
+ // Target for determining text safety.
144
+ OPTIMIZATION_TARGET_TEXT_SAFETY = 40;
145
+
146
+ // Target for ranking Android home modules.
147
+ OPTIMIZATION_TARGET_SEGMENTATION_ANDROID_HOME_MODULE_RANKER = 41;
148
+
149
+ // Target to support running Compose On-Device.
150
+ OPTIMIZATION_TARGET_COMPOSE = 42;
151
+
152
+ // Target for generating passage embeddings.
153
+ OPTIMIZATION_TARGET_PASSAGE_EMBEDDER = 43;
154
+
155
+ // Target for breaking up sentences into phrases.
156
+ OPTIMIZATION_TARGET_PHRASE_SEGMENTATION = 44;
157
+
158
+ // Target to determine whether to show promotion for Compose.
159
+ OPTIMIZATION_TARGET_SEGMENTATION_COMPOSE_PROMOTION = 45;
160
+
161
+ // Target for ranking URL visits used in visit resumption features.
162
+ OPTIMIZATION_TARGET_URL_VISIT_RESUMPTION_RANKER = 46;
163
+
164
+ // Target for background segmentation of video frames.
165
+ OPTIMIZATION_TARGET_CAMERA_BACKGROUND_SEGMENTATION = 47;
166
+
167
+ // Target for History search model.
168
+ OPTIMIZATION_TARGET_MODEL_EXECUTION_FEATURE_HISTORY_SEARCH = 48;
169
+
170
+ // Target for Prompt API feature config.
171
+ OPTIMIZATION_TARGET_MODEL_EXECUTION_FEATURE_PROMPT_API = 49;
172
+
173
+ // Target for metrics based segmentation clustering.
174
+ OPTIMIZATION_TARGET_SEGMENTATION_METRICS_CLUSTERING = 50;
175
+
176
+ // Target for Summarize API feature config.
177
+ OPTIMIZATION_TARGET_MODEL_EXECUTION_FEATURE_SUMMARIZE = 51;
178
+
179
+ // Target for Password Manager form classification model.
180
+ OPTIMIZATION_TARGET_PASSWORD_MANAGER_FORM_CLASSIFICATION = 52;
181
+
182
+ // Target for model classifying notification content as suspicious.
183
+ OPTIMIZATION_TARGET_NOTIFICATION_CONTENT_DETECTION = 53;
184
+
185
+ // Target for History query intent model.
186
+ OPTIMIZATION_TARGET_MODEL_EXECUTION_FEATURE_HISTORY_QUERY_INTENT = 54;
187
+ }
188
  Source: [DEJAN](https://dejan.ai/blog/chrome-ai-models/)