Voice Assistant Guide
Overview
The TrafficPOS Voice Assistant is an AI-powered natural language interface that allows customers and staff to interact with the POS system using voice commands. It uses OpenAI's GPT-4 model to understand natural language and process product requests intelligently.
Natural Language: The voice assistant can understand natural speech patterns and cannabis terminology, making customer interactions faster and more intuitive.
Key Features
Advanced Voice Recognition
- Continuous listening mode for hands-free operation
- Real-time transcription with high accuracy
- Background noise suppression technology
- Multi-language support (based on browser settings)
AI Intelligence
- Natural language understanding powered by GPT-4
- Product name fuzzy matching for variations
- Weight expression parsing (grams, eighths, quarters, etc.)
- Confidence scoring for accuracy verification
- Context-aware responses and suggestions
Smart Product Detection
- Automatic product identification from speech
- Weight unit conversion (eighths to grams, etc.)
- Batch adding multiple products to cart
- Visual confidence indicators for reliability
Initial Setup
1
Enable Voice Assistant
Navigate to Settings → Voice Assistant → Enable Voice Assistant
2
Configure OpenAI Integration
- Get an API key from OpenAI Platform
- Enter the key in Settings → Voice Assistant
- Ensure your OpenAI account has available API credits
- Test the connection using the "Test API Key" button
Security: Store your OpenAI API key securely. It's encrypted in backups but visible in settings.
3
Configure Preferences
Set up voice assistant behavior:
- Auto-start: Begin listening when POS page loads
- Privacy Mode: Hide transcripts from customer view
- Sound Effects: Audio feedback for interactions
- Listening Timeout: How long to wait for speech
4
Grant Browser Permissions
- Allow microphone access when prompted
- Ensure connection uses HTTPS (required for security)
- Test microphone functionality
Using the Voice Assistant
Starting Voice Recognition
Method 1: Auto-start (Recommended)
- Enable auto-start in settings
- Voice assistant begins listening when POS loads
- Ideal for busy dispensary environments
Method 2: Manual Activation
- Click microphone button in right sidebar
- Use keyboard shortcut (Ctrl+M or Cmd+M)
- Perfect for occasional use or privacy needs
Speaking Product Requests
Natural Speech: Speak naturally! The AI understands casual conversation and cannabis terminology.
Natural Product Requests:
- "I'd like 7 grams of Gorilla Glue"
- "Can I get an eighth of Blue Dream?"
- "Add a quarter of your best indica"
- "Show me 14 grams of Purple Haze"
- "I need some Wedding Cake, about 3.5 grams"
Supported Weight Expressions
The system understands various weight formats:
| Measurement Type | Examples | Equivalent |
|---|---|---|
| Gram Measurements | "7g", "7 grams", "seven grams" | 7.0g |
| Eighths | "an eighth", "1/8", "eighth" | 3.5g |
| Quarters | "a quarter", "1/4", "quarter" | 7g |
| Half Ounces | "half ounce", "1/2 oz", "half" | 14g |
| Ounces | "an ounce", "1 oz", "ounce" | 28g |
Understanding the Interface
Voice Panel (Right Sidebar)
Control Elements:
- Microphone Button: Start/stop listening mode
- Audio Level Indicator: Visual feedback of voice input
- Status Indicators:
- Listening active (green)
- AI processing (blue)
- Privacy mode enabled
- Real-time mode active
Transcript Display
Features:
- Shows complete conversation history
- Auto-scrolls to latest interactions
- Hidden completely in privacy mode
- Searchable for reference
Detected Products Panel
Product Information Display:
- Lists all identified products from speech
- Shows confidence scores with color coding:
- High Confidence (>80%): Likely correct match
- Medium Confidence (50-80%): Good match, verify
- Low Confidence (<50%): Check carefully
- Weight/quantity automatically detected
- One-click "Add to Cart" buttons
Best Practices for Accuracy
Clear Recognition Techniques
1
Speak Naturally
- Use normal conversational tone
- No need to yell or over-enunciate
- AI understands natural speech patterns
2
Pause Between Items
Structure requests clearly: "I'd like... 7 grams of Blue Dream... and... an eighth of Gorilla Glue"
3
Use Common Terminology
- AI understands cannabis slang and common terms
- "Bud", "flower", "tree", etc. all work
- Include strain names when known
4
Be Specific with Quantities
- Always include weights or amounts
- "Some Blue Dream" vs "7 grams of Blue Dream"
- Specify units when unclear
Environmental Considerations
Optimize Your Setup:
- Reduce Background Noise: Music and conversations affect accuracy
- Microphone Positioning: Keep device 1-2 feet away from speaker
- Check Audio Levels: Use the visual indicator to ensure proper input
- Verify Products: Always check the detected products panel before adding
Privacy & Security Features
Data Protection
Privacy First: Your privacy is protected: voice processing happens locally, and only text transcripts are sent to OpenAI for product matching.
Security Measures:
- Voice processing handled locally by browser
- Only text transcripts sent to OpenAI
- No audio recordings stored anywhere
- Transcripts automatically cleared on logout
- API keys encrypted in backup files
Privacy Mode
When Privacy Mode is Enabled:
- Transcripts completely hidden from view
- No visual indication of spoken words
- Product detection still functions normally
- Cart updates work seamlessly
- Perfect for customer-facing interactions
OpenAI Integration Security
- API key stored locally only
- Encrypted in system backups
- No customer personal data sent to OpenAI
- Only product matching queries transmitted
- Full control over data sharing
Troubleshooting Common Issues
Microphone Problems
Microphone Not Working:
- Check browser permissions in address bar
- Ensure connection uses HTTPS
- Try a different browser (Chrome recommended)
- Check system microphone settings
- Test with other voice applications
AI Response Issues
AI Not Responding:
- Verify OpenAI API key is entered correctly
- Check OpenAI account for available credits
- Use "Test API Key" button in settings
- Check browser console for error messages
- Try refreshing the page
Recognition Accuracy Problems
Poor Speech Recognition:
- Reduce background noise sources
- Speak more clearly and at normal volume
- Check microphone positioning
- Try different browser or device
- Ensure stable internet connection
Product Detection Issues
Products Not Being Detected:
- Check that product names match inventory
- Verify product catalog is loaded properly
- Use exact product names from inventory
- Check confidence scores for partial matches
- Try alternative product name variations
Advanced Tips & Techniques
Speed Up Customer Service
Efficiency Techniques:
- Say multiple items in one sentence
- Use "Add All" button for batch adding
- Pre-load common customer requests
- Learn your most popular product names
- Use consistent terminology across staff
Improve Accuracy Over Time
Learning Strategies:
- Familiarize yourself with exact product names
- Use consistent weight terminology
- Speak weights clearly and distinctly
- Pause appropriately between items
- Practice with common customer requests
Privacy Best Practices
Customer Privacy:
- Enable privacy mode during customer interactions
- Clear transcripts regularly
- Mute microphone when discussing private matters
- Use headset for staff-only conversations
- Position display away from customer view
Accessibility Features
Keyboard Shortcuts
Quick Access Commands:
- Ctrl/Cmd + M: Toggle microphone on/off
- Ctrl/Cmd + P: Toggle privacy mode
- Esc: Stop listening immediately
- Ctrl/Cmd + T: Clear transcript history
Screen Reader Compatibility
Accessibility Support:
- Complete ARIA label implementation
- Transcript content readable by screen readers
- Status announcement for state changes
- Product confirmation read-aloud
- Keyboard navigation support
Future Enhancements (Coming Soon)
Planned Features:
- "What's your strongest sativa?"
- "Show me products under $50"
- "What's the THC content of Blue Dream?"
- "Compare Wedding Cake and Gelato"
- Advanced conversation memory
- Multi-language support expansion
Continuous Learning: The voice assistant learns from usage patterns and will become more accurate over time as it adapts to your dispensary's specific product names and customer speech patterns.
Related Guides
Advanced Voice Commands
Complex voice operations and batch commands
Offline Mode Guide
Voice assistant works completely offline
Initial Setup
System configuration and API setup