search_webapps_docs tool.search_webapps_docs for current docs, handle unavailable MCP tools explicitly, and keep the first code change small.Use https://wearables.developer.meta.com/docs/develop/webapps/build/, then use the Wearables MCP endpoint https://mcp.developer.meta.com/wearables to call search_webapps_docs for current Meta Ray-Ban Display Web Apps constraints, setup, testing, and publishing guidance. If search_webapps_docs is unavailable, use the linked build guide and state that MCP docs lookup was unavailable before proceeding. Inspect my project first, then build the smallest working Web App for this idea: [describe the app]. It must render in a fixed 600 x 600 pixel viewport, avoid scrolling, use a dark additive-display UI, support arrow-key navigation and Enter activation, and keep all interactive elements reachable without mouse or touch input. Run the relevant local checks.
Use https://wearables.developer.meta.com/docs/develop/webapps/build/, then use the Wearables MCP endpoint https://mcp.developer.meta.com/wearables to call search_webapps_docs for current Meta Ray-Ban Display Web Apps input, D-pad navigation, focus-management, viewport, and no-scroll guidance. If search_webapps_docs is unavailable, use the linked build guide and state that MCP docs lookup was unavailable before proceeding. Inspect this Web App first, then add the smallest reliable navigation fix. Preserve arrow-key movement, Enter activation, visible focus states, a fixed 600 x 600 pixel viewport, and no scrolling. Run the relevant local checks.
Use https://wearables.developer.meta.com/docs/develop/webapps/build/, then use the Wearables MCP endpoint https://mcp.developer.meta.com/wearables to call search_webapps_docs for current Meta Ray-Ban Display Web Apps constraints and troubleshooting guidance. If search_webapps_docs is unavailable, use the linked build guide and state that MCP docs lookup was unavailable before proceeding. Inspect this Web App first and identify whether the issue is layout, input navigation, storage, sensors, or deployment. Preserve the fixed 600 x 600 pixel viewport, no-scrolling behavior, arrow-key and Enter input model, and dark additive-display UI. Make the smallest fix and run the relevant local checks.
<head> of your HTML file. This allows your web app to support upcoming discovery surfaces and enables us to message users when a website isn’t compatible with MRBD.<head> <!-- A brief description of your app --> <meta name="description" content="Description of your web app"> <!-- Identify your web app as MRBD-compatible --> <meta name="mrbd-web-app-capable" content="yes"> </head>
| Capability | Description and guidance |
|---|---|
Display | Additive waveguide overlay. Use dark backgrounds/light, high-contrast UI colors. Fixed 600x600px viewport. Avoid scrolling. |
Input | Navigation via Neural Band/captouch gestures translates to standard arrow key and Enter events. On-glasses composer provides text input. No mouse/touch/keyboard. All elements must be focusable. |
Sensors (IMU) | Standard DeviceMotionEvent (accelerometer, gyroscope) and DeviceOrientationEvent (heading, tilt, roll) W3C APIs. Requires user permission. |
Location (GPS) | Standard navigator.geolocation W3C API. Location is fetched from the paired mobile device. Requires user permission. |
Local Storage | Standard Web Storage APIs ( localStorage, sessionStorage). Best for lightweight data (preferences, small caches). Use JSON for structured data. |
App Icons | Use Unicode symbols or high-resolution PNG favicons (>= 52x52 px) via <link> tags or Web App Manifest. SVGs are not supported. |
meta tag to lock the scale and prevent unexpected zooming:<!-- optional --> <meta name="viewport" content="width=600, height=600, initial-scale=1.0, user-scalable=no">
overflow: hidden on the <body> element to ensure no content extends beyond the viewport boundary:body {
width: 600px;
height: 600px;
overflow: hidden;
}
ArrowUp, ArrowDown, ArrowLeft, ArrowRight) and Enter events delivered to your Web App.// — Input Constants —
const DPAD = {
UP: 'ArrowUp', DOWN: 'ArrowDown',
LEFT: 'ArrowLeft', RIGHT: 'ArrowRight',
SELECT: 'Enter', BACK: 'Escape',
};
// — Focus Management —
function moveFocus(direction) {
var focusables = Array.from(
document.querySelectorAll('.focusable:not([disabled]):not(.hidden)')
);
if (!focusables.length) return;
var idx = focusables.indexOf(document.activeElement);
if (idx === -1) { focusables[0].focus(); return; }
var next = (direction === 'up' || direction === 'left')
? (idx > 0 ? idx - 1 : focusables.length - 1)
: (idx < focusables.length - 1 ? idx + 1 : 0);
focusables[next].focus();
focusables[next].scrollIntoView({ block: 'nearest', behavior: 'smooth' });
}
// — D-pad Listener —
document.addEventListener('keydown', function(e) {
switch (e.key) {
case DPAD.UP: moveFocus('up'); break;
case DPAD.DOWN: moveFocus('down'); break;
case DPAD.LEFT: moveFocus('left'); break;
case DPAD.RIGHT: moveFocus('right'); break;
case DPAD.SELECT:
if (document.activeElement.classList.contains('focusable')) {
document.activeElement.click();
}
break;
case DPAD.BACK: history.back(); break;
default: return; // don't preventDefault on unhandled keys
}
e.preventDefault();
});
<!-- Mark interactive elements with the focusable class --> <button class="focusable" data-action="settings">Settings</button> <button class="focusable" data-action="start">Start</button>
.focusable {
transition: all 150ms ease;
border: 2px solid transparent;
min-height: 88px; /* glasses minimum tap target */
}
.focusable:focus {
outline: none;
border-color: #00d4ff;
box-shadow: 0 0 20px rgba(0, 212, 255, 0.4);
}
input and change events.flowchart TD
A["User navigates\nvia D-pad"] --> B["Text field\nreceives focus"]
B --> C{"User pinches\n(taps)?"}
C -->|No| D["Field stays focused.\nComposer does not open"]
C -->|Yes| E["Composer panel opens\n(handwriting \+ voice)"]
E --> F["User enters text"]
F --> G["Text committed\nto field"]
G --> H["'input' event fires\non your element"]
H --> I{"More input\nneeded?"}
I -->|Yes| F
I -->|No| J["User navigates away.\nComposer closes"]
J --> K["'change' event fires"]
.focus() will not surface the composer, so user-initiated activation is required.<input type="text"><input type="search"><input type="email"><input type="url"><input type="tel"><input type="number"><textarea>contenteditable elements<input type="password"><input type="date"><input type="checkbox"><input type="radio"><!-- Search field --> <input type="search" id="search" class="focusable" placeholder="Tap to write or speak" /> <!-- Multi-line notes field --> <textarea id="note" class="focusable" placeholder="Tap to write or speak" ></textarea>
// Read the composed text using standard event listeners in JavaScript.
const note = document.getElementById('note');
//The composer commits text via the 'input' event
note.addEventListener('input', () => {
console.log('Current text:', note.value);
});
// 'change' fires when the field loses focus after editing
note.addEventListener('change', () => {
console.log('Final text:', note.value);
});
| Do | Don’t |
|---|---|
Provide a clear, descriptive placeholder or aria-label | Leave fields without hints |
Use supported input types ( text, search, email, url, tel, number) | Use type="password" (since the composer won’t open) |
Listen for input events to read composed text | Listen for keydown events (since no physical keyboard exists) |
Provide a fallback if the composer is unavailable | Assume the composer will always be available |
Make fields focusable and navigable via D-pad | Rely on mouse-click or touch to open fields |
inputmode and enterkeyhint attributes do not affect the composer behavior. The type attribute controls only whether the field is eligible.<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8" />
<meta name="viewport"
content="width=600, height=600, initial-scale=1.0, user-scalable=no" />
<title>Search</title>
<style>
.
.
.
</style>
</head>
<body>
<!-- Text field: opens composer on focus + tap -->
<input
type="search"
id="search"
class="focusable"
placeholder="Tap to write"
/>
<div id="results" aria-live="polite"></div>
<script>
const searchField = document.getElementById('search');
const results = document.getElementById('results');
// Read composed text from the field
searchField.addEventListener('input', () => {
results.textContent = 'Searching: ' + searchField.value;
});
// D-pad Navigation
const focusables = Array.from(document.querySelectorAll('.focusable'));
document.addEventListener('keydown', (e) => {
const idx = focusables.indexOf(document.activeElement);
if (e.key === 'ArrowDown' || e.key === 'ArrowRight') {
focusables[(idx + 1) % focusables.length].focus();
e.preventDefault();
} else if (e.key === 'ArrowUp' || e.key === 'ArrowLeft') {
focusables[(idx - 1 + focusables.length) % focusables.length].focus();
e.preventDefault();
} else if (e.key === 'Enter') {
document.activeElement.click();
e.preventDefault();
}
});
focusables[0].focus();
</script>
</body>
</html>
type="password" fields are excluded. | Use type="text" if composer input is needed. |
| Programmatic .focus() does not open composer. | Only user-initiated tap opens the composer. | Let the user navigate and tap the field. |
| inputmode or enterkeyhint has no effect. | These attributes are not honored by the on-glasses composer. | Remove them or leave as progressive enhancement for other platforms. |
| Text input features are simply not working. | Firmware version below v127. | Update glasses firmware to v127 or later. |DeviceMotionEvent and DeviceOrientationEvent web APIs. Simply add event listeners on window as you would in any mobile browser.DeviceOrientationEvent.requestPermission() exists and call it before attaching listeners.function startIMU() {
window.addEventListener('deviceorientation', handleOrientation);
window.addEventListener('devicemotion', handleMotion);
}
// Check whether requestPermission exists before calling it
if (typeof DeviceOrientationEvent !== 'undefined' &&
typeof DeviceOrientationEvent.requestPermission === 'function') {
// Platforms that require explicit permission (e.g., iOS Safari)
DeviceOrientationEvent.requestPermission()
.then(function(state) {
if (state === 'granted') {
startIMU();
}
});
} else {
// Glasses runtime and most Android browsers grant automatically
startIMU();
}
history.pushState() or SPA routing) before the sensor permission request resolves. Doing so can leave the DeviceMotionEvent.requestPermission() promise pending indefinitely, causing the app to hang when sensors are requested. To avoid this:history.pushState() or SPA routing before the sensor permission completes.await it before changing browser history.DeviceMotionEvent provides real-time accelerometer and gyroscope readings. Use it to detect movement, measure G-forces, or track rotation speed.window.addEventListener('devicemotion', function(e) {
// Accelerometer (including gravity), in m/s²
var ax = e.accelerationIncludingGravity.x;
var ay = e.accelerationIncludingGravity.y;
var az = e.accelerationIncludingGravity.z;
// Compute magnitude in G-force
var g = Math.sqrt(ax * ax + ay * ay + az * az) / 9.81;
document.getElementById('gforce').textContent = g.toFixed(2) + ' G';
// Gyroscope (rotation rate in degrees/second)
var yawRate = e.rotationRate.alpha;
var pitchRate = e.rotationRate.beta;
var rollRate = e.rotationRate.gamma;
});
DeviceOrientationEvent provides the current orientation of the glasses relative to the Earth. Use it for compass heading, tilt detection, or spatial UI.window.addEventListener('deviceorientation', function(e) {
var heading = e.alpha; // Compass direction (rotation around z-axis): 0-360°
var tilt = e.beta; // Forward/back tilt (rotation around x-axis): -180° to 180°
var roll = e.gamma; // Left/right tilt (rotation around y-axis): -90° to 90°
document.getElementById('heading').textContent = heading.toFixed(1) + '°';
});
| Consider | Avoid |
|---|---|
Requesting permission from a user gesture (for example, button press) | Calling requestPermission() automatically on page load |
Checking for API availability before attaching listeners | Assuming DeviceOrientationEvent is always defined |
Throttling or debouncing high-frequency sensor updates for UI rendering | Updating the DOM on every single sensor event without throttling |
Using accelerationIncludingGravity for tilt-based interactions | Relying on acceleration alone when gravity context is needed |
Removing event listeners when sensor data is no longer needed | Leaving listeners active in the background, which drains battery |
navigator.geolocation web API. Location data is fetched from the wearer’s paired mobile device, since the glasses themselves do not have location-aware sensors. Use the API exactly as you would in any Web App. Like Sensor Data, Location also requires user permission.getCurrentPosition to request a single location fix.navigator.geolocation.getCurrentPosition(
function(position) {
var coords = position.coords;
console.log('Latitude: ' + coords.latitude); // Decimal degrees
console.log('Longitude: ' + coords.longitude); // Decimal degrees
console.log('Accuracy: ' + coords.accuracy); // m
console.log('Altitude: ' + coords.altitude); // m (may be null)
console.log('Speed: ' + coords.speed); // m/s (may be null)
console.log('Heading: ' + coords.heading); // Degrees from north (may be null)
console.log('Timestamp: ' + position.timestamp); // ms since epoch (UTC)
},
function(error) {
// error.code:
// 1 = PERMISSION_DENIED: wearer denied permission request
// 2 = POSITION_UNAVAILABLE: location could not be retrieved (i.e., phone offline)
// 3 = TIMEOUT: request exceeded the timeout
// error.message - human-readable description
console.error('Geolocation error:', error.code, error.message);
},
{ timeout: 15000 }
);
watchPosition to receive ongoing location updates as the wearer moves.var watchId = navigator.geolocation.watchPosition(
function(position) {
// Called each time the position updates
updateMap(position.coords.latitude, position.coords.longitude);
},
function(error) {
// error.code:
// 1 = PERMISSION_DENIED: wearer denied permission request
// 2 = POSITION_UNAVAILABLE: location could not be retrieved (i.e., phone offline)
// 3 = TIMEOUT: request exceeded the timeout
// error.message - human-readable description
console.error('Watch error:', error.code, error.message);
}
);
clearWatch when updates are no longer needed.// Stop watching when done navigator.geolocation.clearWatch(watchId);
getCurrentPosition and watchPosition accept an optional third argument to configure behavior:| Option | Type | Default | Description |
|---|---|---|---|
enableHighAccuracy | boolean | false | Request the most accurate position available. May take longer and use more power. |
timeout | number | Infinity | Maximum time (in milliseconds) to wait for a position. Use 10000-15000 ms as a practical default. |
maximumAge | number | 0 | Accept a cached position if it is no older than this value (in milliseconds). |
navigator.geolocation.getCurrentPosition(successCb, errorCb, {
enableHighAccuracy: true, // Request most accurate position (boolean, default false)
timeout: 15000, // Max wait time in ms (number, default Infinity)
maximumAge: 5000 // Accept cached position if newer than this in ms (number, default 0)
});
| Consider | Avoid |
|---|---|
Using a timeout of 10-15 seconds (10000-15000 ms), since the first request may take several seconds | Omitting using a timeout or setting it too low |
Handling PERMISSION_DENIED gracefully, since the wearer must grant permission | Assuming wearer does not need to grant permissions |
Ensuring permissions requests are triggered by a user gesture | Assuming permission requests are triggered |
| Description | Error code | Type |
|---|---|---|
Wearer denies the permission prompt | 1 | PERMISSION_DENIED |
Location data could not be retrieved (for example, companion device is offline) | 2 | POSITION_UNAVAILABLE |
Request exceeded the specified timeout | 3 | TIMEOUT |
localStorage and sessionStorage, to persist lightweight data on MRBD glasses:localStorage persists data across sessions, even after the app is closed and reopened.sessionStorage persists data only for the current session, so values are cleared when the session ends.setItem, getItem, and removeItem methods.// Save a value
localStorage.setItem('userPreference', 'dark');
// Read a value
var preference = localStorage.getItem('userPreference');
// Returns 'dark', or null if the key does not exist
// Remove a value
localStorage.removeItem('userPreference');
// Clear all stored data
localStorage.clear();
sessionStorage has an identical API, but scopes data to the current session. Use it for temporary states that should not persist after the user exits your app.// Track whether the user has seen the onboarding screen this session
if (sessionStorage.getItem('onboardingSeen')) {
showMainScreen();
} else {
showOnboarding();
sessionStorage.setItem('onboardingSeen', 'true');
}
localStorage: 5 MBsessionStorage: 5 MBsw.js) that runs in the background.| Requirement | Details |
|---|---|
HTTPS | Service workers only register in a secure context. Your app must be served over https://. Local file:// URLs won’t work. |
Single app shell | Your app’s core files must be identifiable as a cacheable set. |
No permission prompt | Offline mode works in the background, so it does not require user permission. |
index.html or app.js), register the serviceWorker:if ('serviceWorker' in navigator) {
navigator.serviceWorker.register('/sw.js')
.then((registration) => {
console.log('Service Worker registered:', registration.scope);
})
.catch((error) => {
console.log('Service Worker registration failed:', error);
});
}
sw.js at your app’s root. This file handles caching and request interception.// Define a versioned cache name and the files to precache.
const CACHE_NAME = 'my-app-v1';
const APP_SHELL = [
'/',
'/index.html',
'/app.js',
'/styles.css'
];
// Install: precache the app shell.
self.addEventListener('install', (event) => {
event.waitUntil(
caches.open(CACHE_NAME).then((cache) => cache.addAll(APP_SHELL))
);
});
// Activate: clean up old caches on version bump.
self.addEventListener('activate', (event) => {
event.waitUntil(
caches.keys().then((names) =>
Promise.all(
names
.filter((name) => name !== CACHE_NAME)
.map((name) => caches.delete(name))
)
)
);
});
// Fetch serve from cache first, fall back to network.
self.addEventListener('fetch', (event) => {
event.respondWith(
caches.match(event.request).then((cached) => cached || fetch(event.request))
);
})
function updateConnectionStatus() {
const status = document.getElementById('connection-status');
if (navigator.onLine) {
status.textContent = '● Online';
status.style.color = '#00d4ff';
} else {
status.textContent = '● Offline';
status.style.color = '#ffaa00';
}
}
window.addEventListener('online', updateConnectionStatus);
window.addEventListener('offline', updateConnectionStatus);
// Set initial state
updateConnectionStatus();
<div id="connection-status" style="font-size: 14px; padding: 8px;"></div>
CACHE_NAME (e.g., change my-app-v1 to my-app-v2). The new service worker will install alongside the old one, precache the updated files, and clean up the outdated cache on activation.// Update this version string whenever you update your app const CACHE_NAME = 'my-app-v2';
| Do | Don’t |
|---|---|
Precache all files your app needs to render its initial screen. | Assume every request will succeed. Always handle the offline case. |
Use a versioned cache name and clean old caches on activate. | Leave stale caches accumulating on the device. |
Show a clear offline indicator, so your wearers know what to expect. | Silently fail or show broken content when offline. |
Combine with localStorage for persisting user data between sessions. | Depend solely on the cache for user-generated data. |
Decide which content makes sense offline and show a friendly message for content that requires fresh data. | Try to cache everything, including API responses that change frequently. |
APP_SHELL array exactly match the URLs your app actually requests. Mismatched paths will cause cache misses, so your app won’t load offline.if ('serviceWorker' in navigator) {
// Safe to register
} else {
// Offline support not available — app still works, just requires a connection
}
async function fetchData(url) {
try {
const response = await fetch(url);
return await response.json();
} catch (error) {
// Network unavailable -- show cached or placeholder content
showOfflineMessage('This content requires an internet connection.');
return null;
}
}
navigator.serviceWorker.register() resolves successfully.favicon.ico) for this content. If no suitable icon is found, a default fallback icon is shown. SVGs are not supported.<link> tags in your page’s <head> section.<link rel="icon" href="/icon-96.png" sizes="96x96"> <link rel="apple-touch-icon" href="/apple-touch-icon.png" sizes="180x180">
icons array must include a src attribute and ideal sizes.<link rel="manifest" href="/manifest.webmanifest">
{
"icons": [
{ "src": "/icons/icon-96.png", "sizes": "96x96" },
{ "src": "/icons/icon-192.png", "sizes": "192x192" }
]
}