Skip to content

Use files and photos as context

Hedy can work with the text in your documents and photos as well as with what it hears. Attach a price list or a CV to a context, or add a project brief or a photo of the whiteboard to a session, and Hedy uses that text when it answers your questions, writes your recap and detailed notes, and suggests what to say next.

Adding files and photos is part of Hedy Pro. Team members with an active seat can use it too.

Add files to a context

Files on a context go into every session that uses that context, so this is the place for material you reuse, like a price list, your CV or a product sheet.

  1. Open Settings and go to the Personalization tab.
  2. Under Session AI Context & Instructions, open the context you want, or create one (see Managing Custom Contexts).
  3. In the Files section, tap Attach files and pick one or more files. On a computer you can also drag files onto the context.

Hedy reads PDF, Word (.docx), PowerPoint (.pptx), Excel (.xlsx), CSV, text and Markdown files, and JPEG, PNG, HEIC and WebP images. For Pages, Numbers and Keynote files it reads the PDF preview stored inside the file, so if a file has no preview, export it as PDF first. Old .doc, .xls and .ppt files don’t work, so save them as .docx, .xlsx or .pdf instead. Hedy can’t read password-protected files.

You can see a context’s files in the web app, but you add and remove them in the Hedy app on your computer or phone.

Once you add a file, Hedy indexes it on your device. You’ll see the progress next to the file, and Ready when it’s done.

Add files to a topic

Files on a topic go into every session filed under that topic and into the topic’s own chat. Use them for material that belongs to one client, project or course, like a contract, a project plan or a syllabus.

  1. Open the topic and go to its Settings tab.
  2. In the Files section, tap Attach files and pick one or more files. On a computer you can also drag files onto the section.

Topics take the same file types as contexts. You can add files to topics you own. Topics shared with you and Team topics don’t have a Files section. The web app shows a topic’s files but you add and remove them in the Hedy app. If you delete a topic, its files are deleted with it.

Add files and photos to a session

Files and photos you add to a session only inform that meeting: an agenda, a client’s brief, a photo of the whiteboard. You can add them to sessions you own while they’re running or after they’ve ended. To have a file ready before a meeting, attach it to the context you’ll use. They live in the Files & photos card at the top of the session’s Notes tab, which is collapsed until you open it.

  1. Open the session and go to the Notes tab.
  2. Click Files & photos to expand the card.
  3. Click Add files or photos. On a computer the file picker opens. On a phone, choose Take photo, Choose from library (up to ten photos at once) or Choose files.

If you add a file while you’re typing in Notes, Hedy puts a line with 📎 and the file’s name where your cursor is, so the recap and chat know which part of your notes the file goes with.

Sessions take the same file types as contexts. On Mac and Windows you can also drop files and images onto a session that’s open on the Sessions tab, or copy files in Finder or File Explorer and paste them into the Notes editor with Cmd+V or Ctrl+V. A copied web link still pastes as text.

During a meeting it’s often quicker to use the camera in the empty chat box. On a phone, tap it and choose Take photo or Choose from library. As soon as you type, the send button replaces it. On Mac and Windows it opens the image picker, and you can also paste an image into the chat input. Photos added from chat go into the same card, and Hedy shows Added to Notes with a View button that opens the card.

The recap lists the files and photos that are ready under Files & photos from this session. Manage in Notes takes you to the card.

Check and manage your files

Each file or photo is a row in the card. The card’s header shows how many there are, how many are still indexing and how many couldn’t be read.

  • A file shows its type, its page count for PDFs, and its status, for example PDF · 3 pages · Ready. While Hedy reads it you’ll see Indexing….
  • A photo shows a preview on the device that added it, and Saved on this device. Choose Show text to see the text Hedy read, and Hide text to close it.
  • If reading failed and the original is on this device, choose Try again.
  • Choose Remove file or Remove photo to remove it from the session.
  • On another device the row says File stays on or Photo stays on and names the device that holds the original.

The web app is read-only for files and photos. Add or remove them in Hedy on your phone or computer.

What Hedy does with them

Hedy reads the text in your files and photos on your device, using the device’s own text recognition for photos and scanned pages. When the files on a session, its context and its topic are short enough, Hedy uses all of their text: about a page for live suggestions, a few pages for chat, and more for the recap and detailed notes. When they’re longer, it picks the parts that matter for what you’re doing:

  • In chat, when you ask a question, Hedy looks for passages that match and uses them in its answer.
  • In the recap and detailed notes, passages that match the conversation help Hedy get names, numbers and facts right.
  • During a session, Hedy can use facts from your context files, your topic files, your session files and the text of your session photos when it suggests what to say.

Hedy treats this text as reference material and won’t follow instructions written inside your files.

Smarter file context (optional)

Without it, Hedy uses short files in full and, in longer ones, finds the passages that share words with the conversation. On Apple Silicon Macs, Windows, iPhone, iPad and supported Android devices you can also download Smarter file context, which helps Hedy find the right passages even when people use different words. It’s a download, not a switch. If Hedy says smarter file context is off on this device, that device hasn’t downloaded it yet.

When you have files and haven’t downloaded it, a Smarter file context card appears with your files, in a session’s Files & photos card and in a context’s Files section. Click Download (310 MB). You can also download it in Settings → Speech & AI → Smarter file context. It’s a one-time download for each device, and it stays on that device. After a session that used files, Hedy may also offer the download on a device that doesn’t have it yet, in a prompt titled Get more from your files.

On a phone, large downloads wait for Wi-Fi. Tap Download now (310 MB) to use mobile data instead. On a computer with a data limit on its connection, Hedy asks before downloading anyway.

To free up the space, go to Settings → Speech & AI → Smarter file context and choose Remove next to File context. Hedy still matches exact words in your files, and you can download it again later.

Live suggestions on different devices

During a live session Hedy has less room for file text than it has in chat or recaps: about a page for all the files on the session and its context together. If they fit, live suggestions use all of their text on any device. If they don’t, live suggestions use only the passages Smarter file context picks for the conversation, and that needs a device fast enough to search your files while the session runs.

Apple Silicon Macs, iPhone 15 Pro or newer and iPads with an M-series or A17 Pro chip qualify as soon as the download finishes. Other devices, such as Windows PCs and Android phones, run a short speed check right after the download, and phones and tablets also need enough memory. Hedy then shows under Smarter file context whether live suggestions use your files on this device. If the check fails, you can run it again with Check again. On a device that doesn’t qualify, live suggestions leave your files out once together they’re longer than about a page.

To give live suggestions your key facts on any device, put them in the context’s own text. A context holds up to 20,000 characters, and live suggestions read all of it in every session that uses that context. A good setup is a summary of the facts you need most in the context text, with the full documents attached as files for chat, recaps and detailed notes. Changes to the context text apply from the next session, or when you apply the context to a session again.

Chat, recaps and detailed notes use all of your files on every device. On any device that has downloaded Smarter file context, the recap and detailed notes use it once the session ends and speech recognition has finished. While a session is running on a device that doesn’t qualify for live suggestions, chat matches exact words. Session photos work the same everywhere.

Privacy

  • Hedy keeps a copy of each file or photo on the device you added it from and never uploads the file or photo itself.
  • Cloud Sync is your choice. If it’s on, the text Hedy read, the file name and type, and the search data are stored in your account’s data region so your other devices can use them. If it’s off, they’re stored only on the device.
  • With cloud AI analysis, Hedy sends selected text from your files and photos, plus the file names, to our AI providers, along with the transcript and on the same terms. Short files may be sent in full. This happens whether or not Cloud Sync is on.
  • If you use Local AI, the analysis runs on your device and no file text goes to our AI providers. If Cloud Sync is on, the text is still stored in your account’s data region.
  • Removing a file or photo, or deleting its context or session, deletes the text and search data on that device and, if Cloud Sync is on, in the cloud and on your other devices once they sync. Deleting your account deletes them in the cloud. Your original file elsewhere on your computer or phone isn’t touched. On the web, the text Hedy read stays in your browser until you sign out.

For how Hedy handles your data in general, see Data Privacy Overview.