Apple TV direct control – the iRemote

I’ve been thinking about this more recently, following my musings last year on the subject, and have been wondering how Apple can improve the Apple TV beyond simply offering more content, adding an app store and enabling TV gaming. Here are some thoughts.

To my eyes one of the biggest obstacles is input.


TV remotes aren’t equipped to handle what we do with TV in the 21st century and the chewing gum remote included with the Apple TV is a relic disguised in sleek aluminium, easily lost body. A directional pad is slow and frustrating, and using the Apple remote app is even worse providing over-sensitive touchpad directional control which is near impossible to use with any accuracy. Touch screens are smooth and expansive, remotes have bumpy buttons of varying shapes and sizes utilising physical feedback and muscle memory to learn it’s functions. A touch-screen experience only works when the thing you are manipulating is visible directly under your finger looking at the screen you are touching, when it is a disconnected experience controlling an interface the other side of the room it is much harder to connect the two in your mind. The Apple remote app is only currently useful for keyboard entry when searching effectively, for which a d-pad is appalling.


What does work well is forgoing using the Apple TV UI altogether and just finding what you want in an app (like Netflix), then AirPlaying the content to the big screen. The main disadvantages of AirPlaying everything to your TV are up-streams can get laggy depending upon your home network and will require a fully charged device – airplaying an entire HD movie will take about 70% of a full iPhone charge. It also locks your device out from any other functions – get a text message and your movie pauses, want to email, look something up online, use social media? Tough. Movie pauses.

Therefore I believe the next sensible enhancement to make is to have a separate touch-screen device to direct control your Apple TV rather than remote control. Takeover or mirror the TV screen UI on device and allow direct manipulation, browsing, searching in a native app experience designed for a touch device, when the selected media is playing it’s doing so direct through the Apple TV and not streaming over AirPlay. This approach benefits from all the advantages the iPhone/iPod/iPad gives you, whilst utilising all the strengths of the Apple TV device.

All great, but what about users who want an Apple TV without owning an iPhone, iPod touch or iPad? That’s where the A5 processor might come back into play. I believe Apple is keeping this chipset alive and continuing to reduce it’s production cost as we’ve seen in the recent iPod touch price drop, to bring us a new remote. Imagine an iPod touch that is thinner and lighter, perhaps with an iPhone-S style plastic case, acting as a portal to your Apple TV device. It appears to have all the apps on your TV has installed, with an app store to add more TV apps (and possibly games). A 16:9 ratio screen might make sense to match the TV you’re using.

This remote would require bluetooth & wifi, with a few GB of hard drive for caching files or basic app features/UI, and a much smaller battery – helping to keep costs down. All apps installed are hosted on the Apple TV, but appear as if they are on the device in a manner all users will be familiar with. Extensions could be used to have a child app on the device which controls the parent app on the Apple TV. You could use a ‘handoff’ like feature to continue watching a program on the remote screen while you exit the room, as you stay on the same network (AirPlaying from the Apple TV to the remote). You could also use this device as a controller for games, although this would be terrible beyond simple tapping actions without the tactile feedback you receive from physical controls. Third-party iPhone game controllers might finally have a purpose, or it could spawn a whole generation of compatible wireless controllers? I imagine demanding games will require an A7 powered Apple TV to achieve respectable performance.

This remote device (the iRemote?) could come bundled with Apple TV for a reasonable price (I’m thinking around £199 or less), or be an optional extra that can be purchased (£99 or less). If we’re luckily this could all be achieved with a software update and run on existing Apple TV 3 or even 2 units (with the demanding gaming exceptions mentioned above). Of course if you have an iPhone, iPod touch or iPad then all you would need is an app and a software update. 

Imagine combining this with an Xbox like feed-through from your TV/Sky/Cable service into this the Apple TV to augment your regular watching experience and you have a powerful living room addition.

Whatever Apple decide to do here, the Apple TV software is long overdue for an upgrade. The disconnect between ‘my stuff’ I keep on my Mac on the same network, my iCloud account, and the iTunes store where I can buy and rent media is broken. The service provider apps like Netflix could all benefit from a better UI, and the iRemote device would allow for this and more. I use Apple TV almost daily and look forward to how the platform evolves. I guess only time will tell.

Update 1st July 2014
To follow up on some feedback I’ve gotten so far in person, voice control could be the answer, but it’s not perfect, and there are a lot of hard to pronounce/recognise titles and actors names that would cause problems. But it has potential. 

Also in reaction to Google I/O and the Google TV announcements; it’s a software platform, not hardware, designed for manufacturers to integrate into their products – an extension of Android. This may make the suite of terrible and confusing TV and TV-device UIs better and more consistent if widely adopted (and assuming there is no bloatware this time), but hardware will win the war. If left to a bunch of Android-running third party TV manufacturers, we’ll be stuck with the D-pad forever. 

Technology June 28th 2014

You might also be interested in...

  • Apple TV – our predictionsApple TV – our predictions There has been a lot of talk about what Apple might do in the TV space of late, again. There are rumors of a new device coming to market that will also come with a new SDK allowing developers to produce apps for the device much like […]
  • WWDC 2016 announcement effects on designWWDC 2016 announcement effects on design We all watched WWDC 2016 with anticipation of what new things Apple might be releasing this year. Below is our summary of notable new developments that we can take advantage of and clients should be aware of for future projects. Apple […]
  • Universal Clipboard at WWDC 2016Universal Clipboard at WWDC 2016 Last night (GMT) Apple put on it’s WWDC 2016 event, and as always we were watching with eagle eyes to see what new features and innovations Apple is planning to release this autumn. One of the featured demos for the newly titled macOS was […]

Product Design

The ‘Product’ is the website, service, application, interactive thing being worked on by the business. The practice of Product Design is similar in a lot of ways to UX Design. It involves the coming together of many specific design disciplines...

Call to action (CTA)

A call to action is a marketing term that refers to a prompt that invokes a response leading to a sale. When referring to a call to action (CTA) in the digital design world we usually mean the interactive element that leads to the next step in the experience - something that needs to be clicked or tapped.

User testing

User testing refers to a technique used in the design process to evaluate a product, feature or prototype with real users. There are several reasons why you might want to undergo usability testing, the most common is that it allows the design team to identify friction in a user experience they are designing, so that it can be addressed before being built or deployed.


WYSIWYG (pronounced WIZ-ee-wig) is an acronym for "What You See Is What You Get". It helps identify an an interface that allows user input resulting in an output that is rendered in a similar way. For example; a word processor application interface might resemble a piece of paper,so when printed the user can see how the output will appear.

Content Management System

A content management system (CMS) is an tool that allows a website editor/administrator to manage the content that is displayed. Websites are made of HTML and CSS to create pages. Pages can be hard-coded but would require technical development skills to make changes. A CMS usually allows a person without coding knowledge to amend existing and add new content to a website using a WYSIWYG interface.

Responsive Web Design

Responsive web design refers to a web page that dynamically adapts its layout to fit the size and orientation of the device on which it is viewed. A responsive design allows for a more optimised user experience across desktop and laptop computers as well as smartphones and tablets of varying sizes.

User Stories

User stories allow the functionality of a product or service to be expressed as written descriptions of an experience as seen from the users perspective. The writing of user stories creates a list of design and development tasks to complete in order to create any required functionality.

User Interface

A user interface (UI) is a conduit between human and computer interaction - the space where a user will interact with a computer or machine to complete tasks. The purpose of a UI is to enable a user to effectively control a computer or machine they are interacting with, and for feedback to be received in order to communicate effective completion of tasks.


A persona in UX Design is the characterisation of a user who represents a segment of your target audience. On a project you might create any number of personas to be representative of a range of user needs and desires. The solutions you design must answer these needs in order to deliver value to your target audience.

Card sorting

A great, reliable, inexpensive method for discovering patterns in how users would expect to find content or functionality. Card sorting is used to test the taxonomy of data with a group of subjects, usually to help inform the creation of the information architecture, user flow, or menu structure on a project.


A technique used to generate ideas around a specific topic. Often done in groups, but can be done individuals. The process usually involves writing down all ideas around a topic onto paper, a whiteboard or stickies often implying some kind of association.

Minimum Viable Product

An MVP is a product that has the minimum set of features to prove the most essential hypothesis for a product. Businesses building a new product can create a Minimum Viable Product to prove that an idea is viable and warrants further investment. A further benefit being that the next stage of development can be informed by feedback obtained from testing that MVP.


A sitemap is a diagrammatic representation of a hierarchical system. It usually depicts the parent-sibling relationship between pages in a website, showing how sub pages might be arranged underneath their parent groupings. This arrangement forms a map of the site.

User journey

A user journey represents a sequence of events or experiences a user might encounter while using a product or service. A user journey can be mapped or designed to show the steps and choices presented as interactions, and the resulting actions.


A prototype is draft representation built to test ideas for layout, behaviour and flow in a system. Prototypes are an indispensable tool for resolving a large number of potential issues in a concept or business before too many resources are deployed to put a design into production.


A Wireframe is a visual schematic that conveys a basic level of communication, structure and behaviour during the design of a system. Wireframes are low-fidelity designs that bypass including a detailed user interface or visual design, conveying just enough to get across the core idea.


To say something is usable is a qualitative statement about how easy that thing is to use. Usability is an assessment of how learnable a system is and how easy a user finds it to use. The usability of a system or product is a key factor in determining whether the user experience is a good one.

Information Architecture

Information architecture is the design and organisation of content, pages and data into a structure that aids users understanding of a system. A more organised system enables users to more easily find the information they require and complete the intended tasks.

UI Design

User Interface Design is the discipline of designing software interfaces for devices, ideally with a focus on maximising efficiency, responsiveness and aesthetics to foster a good user experience.

UX Design

The practice of User Experience (UX) Design is the coming together of many specific design related disciplines to improve the usability, responsiveness, uptake and aesthetics of a product or service.

User Experience

A general term that covers all aspects of a user's participation while engaging with something that has been designed. Usually when talking about User Experience in the digital design field it refers to the interactions, reactions, emotions and perceptions while using an app, service, website or product.