Pencil mode
On this page
What pencil mode is
In pencil mode, the app shows a live picture of the computer screen. This manual calls this picture the screen preview. When you draw on the preview with Apple Pencil, the pen draws at the same point on the computer. Drawing apps on the computer get pen input with pressure and tilt, the same as from a graphics tablet.
Only an iPad with an Apple Pencil is a drawing tablet. Pencil mode is also in the app on an iPhone, but you cannot use an Apple Pencil with an iPhone. On an iPhone, you see the screen preview. When Draw with finger
is on, you can draw with one finger.
Start pencil mode
- Connect the app to the server. See Add a device to the server.
- In the toolbar, tap the mode button
. It shows the icon of the current mode. - Tap Pencil
. - Hold the iPad in landscape. On an iPhone, pencil mode turns the screen to landscape.
The server starts to send the screen when a device starts pencil mode. It stops when no device is in pencil mode.
What the computer asks the first time
To send the screen, the server must capture it. The first time, the computer can ask you for permission:
- macOS: macOS must allow ilopad to record the screen. If it does not, the server shows the dialog ilopad cannot see this screen. For the steps, see ilopad cannot see this screen.
- Linux (Wayland): the desktop shows its own screen share dialog. Select one screen and allow the share. The server asks the desktop to keep this choice for the next time.
- Windows and Linux (X11): the computer asks nothing.
If the app shows No screen to draw on or This server is too old, see Pencil mode shows no screen.
Select the screen
Pencil mode shows one screen of the computer. If the computer has more than one monitor, you can change the screen on the server:
- Open the server window on the computer.
- Click the screen button
at the top of the window. Its tooltip is Change shared screen. - Select the screen.
What you see after the click depends on the operating system. On Windows, you can also set the screen in the server settings. For each system, see The screen for pencil mode.
The button shows only when you can change the screen. The pen always draws on the screen that the preview shows.
Draw with Apple Pencil
Touch the preview with Apple Pencil and draw. The app sends these values to the computer:
- Position. The point under the pencil tip, also when you zoom, move or turn the preview.
- Pressure. How hard you press. The pressure curve changes this value before the app sends it to the computer.
- Tilt. The angle of the pencil. The tilt is correct also when you turn the preview.
- Barrel roll. How much you turn the pencil around its own axis. Only Apple Pencil Pro gives this value. It needs iPadOS 17.5 or later.
- Hover. When you hold the pencil tip above the screen, the pointer on the computer follows it. This needs an iPad and an Apple Pencil that support hover.
Apple Pencil has no eraser end. ilopad does not send a pen eraser. To erase, select the eraser tool of the drawing app. To do this, you can set double tap to Eraser Toggle. You can also use the eraser button in the app toolbar.
What reaches the computer on each system
| Value | Linux | macOS | Windows |
|---|---|---|---|
| Position | Yes | Yes | Yes |
| Pressure | Yes, all levels | Yes, all levels | Yes, with fewer levels |
| Tilt | Yes | Yes | Yes |
| Barrel roll | Yes | Yes | No, with the pen tablet driver |
| Hover | Yes | Yes | Yes |
On Windows, the ilopad installer adds a pen tablet driver. Windows gets fewer pressure levels than the iPad sends. The number of levels depends on the pen driver. The pen tablet driver does not send barrel roll.
If the computer does not have the pen tablet driver, the server shows this message: ilopad is not sending your pen as a tablet. Then drawing apps see a mouse and get no pressure. To add the driver, run the ilopad installer again.
Windows: a drawing app that cannot see the pen
Windows gives apps two ways to read a pen: Windows Ink and WinTab. The ilopad pen is a Windows Ink pen. Some drawing apps use WinTab by default. Then they cannot see the pen. When such an app is in front, the server shows a dialog. The dialog tells you how to correct the problem. At this time, the server checks Krita.
To test the pen without a drawing app, use the Pencil tab of the Input Testing window on the server. See Test the input: Pencil.
Use your fingers
With Draw with finger
off, one finger on the preview sends nothing to the computer. You can use these gestures with two and three fingers:
| Gesture | Result |
|---|---|
| Move two fingers | Moves the preview. |
| Pinch two fingers | Zooms the preview in or out. |
| Turn two fingers | Turns the preview. To stop this, turn off Rotate with Two Fingers in Settings. |
| Tap with two fingers | Sends Undo to the app on the computer. |
| Tap with three fingers | Sends Redo to the app on the computer. |
The zoom, the move and the turn change only the preview on the iPad. They do not change the computer. To zoom the drawing app itself, use Pan the remote screen
.
The two-finger tap and the three-finger tap send the undo and redo shortcut of the app in front. You cannot change these two gestures.
When two or more fingers touch the preview, a ring shows under each finger. The ring starts as a pulse of light, then it turns slowly. It shows you where the app reads your fingers. If Reduce Motion is on in iPadOS, the ring does not move.
Fit to Screen
Tap Fit to Screen
in the pencil mode bar. The preview then shows all of the computer screen below the bar. Fit to Screen also makes a turned preview straight again.
Pan the remote screen
When Pan the remote screen
is on in the pencil mode bar, two fingers move and zoom the drawing app on the computer, not the preview. The server sends the pan and zoom shortcuts of that app. A turn of two fingers then does nothing. When you leave pencil mode, the control turns off again.
The server knows the pan and zoom of these apps:
- Pan and zoom: Krita, Inkscape, GIMP, Adobe Photoshop, Adobe Illustrator, Affinity, Clip Studio Paint, MediBang Paint, Adobe Fresco, Apple Freeform, Miro, Pixelmator Pro, Canva, Microsoft Whiteboard.
- Zoom only: Goodnotes, Xodo, ArtRage.
In other apps, the gesture does nothing.
Draw with finger
Tap Draw with finger
in the pencil mode bar. Then one finger draws as a pen. Two-finger and three-finger gestures continue to operate. A stroke starts a short time after the finger touches the screen. Thus the app can see if a second finger also touches.
With Emulate Pressure with Finger on, the app sets the pressure from the size of the finger contact. With it off, a finger always draws at full pressure. A finger sends no tilt.
The pencil mode bar
The bar at the top of pencil mode has these controls. Most controls are icons. The names below are the VoiceOver names.
| Control | What it does |
|---|---|
| Ends the connection, or shows the connection details. See Connection state. | |
| Saves and loads sets of buttons and overlays. See Templates. | |
| Lets you add, move and change your buttons and overlays. See Edit mode. | |
| One finger draws as a pen. See Draw with finger. | |
| The pencil or a finger operates as a mouse. See Mouse emulation. | |
| Two fingers pan and zoom the app on the computer. See Pan the remote screen. | |
| Shows all of the computer screen, with no rotation. | |
| Opens the pressure and tilt curves. See Pressure and tilt curves. | |
| Opens the keyboard. The app sends the text that you type to the computer. | |
| Opens Settings at the Pencil page. | |
| Changes the mode. | |
| Hides the bar. To show it again, tap the tab at the top right corner (Show toolbar). |
When the bar does not have sufficient space, Templates
, Fit to Screen
, Curves
and Settings
move into the More controls
menu. The bar can also hide automatically after some seconds. See Auto-Hide in General settings.
Double tap and squeeze
You can set an action for two Apple Pencil gestures:
- Double Tap: tap two times on the side of the pencil. This needs Apple Pencil (2nd generation) or Apple Pencil Pro. In ilopad it needs iPadOS 17.5 or later.
- Squeeze: squeeze the pencil. This needs Apple Pencil Pro.
To change the action:
- Tap Settings
in the pencil mode bar. - In Apple Pencil Gestures, tap Double Tap or Squeeze.
- Tap an action in Presets. Or tap Custom Key Combo and select a key.
| Preset | What it does |
|---|---|
| Undo | Undo. Default for Double Tap. |
| Redo | Redo. |
| Eraser Toggle | Selects the eraser of the app. |
| Brush Toggle | Selects the brush of the app. |
| Pick Color | Gets the color under the pointer. In Photoshop, Krita and some other apps, it holds the pick key and clicks. Thus the brush stays selected. In other apps, it selects the eyedropper tool. |
| Toggle Overlay | Hides or shows your overlays on the iPad. It sends nothing to the computer. Default for Squeeze. |
A preset is an action, not a key. When ilopad knows the app in front, it sends the shortcut of that app for the action. When it does not know the app, it sends a standard key: Ctrl+Z for Undo, Ctrl+Shift+Z for Redo, E for the eraser, B for the brush, and Alt+click for the color. On a Mac, Command replaces Ctrl.
ilopad always sends a custom key as you selected it.
Shortcuts for the app in front
In pencil mode, the server tells the app which app is in front on the computer. To see this app, tap Connection
in the pencil mode bar. The row Active App shows the name.
ilopad uses this information in these places:
- The app toolbar at the left shows the tools and shortcuts of that app. See The app toolbar.
- Double Tap, Squeeze and the two-finger and three-finger taps send the shortcut of that app.
- Pan the remote screen
uses the pan and zoom keys of that app.
The shortcuts are correct for the system of the computer. For example, Undo is Command+Z on a Mac and Ctrl+Z on Windows and Linux. If an app uses a different key on one system, ilopad sends the key for that system.
On Windows and macOS, the server sees the app in front. On Linux, this depends on the desktop. The server has support for KDE Plasma, GNOME, Sway, Hyprland and X11 desktops.
If ilopad does not know the app, you can select its toolbar by hand. See The app toolbar.
Mouse emulation
Some programs do not use pen input, for example many games. For these programs, turn on Mouse emulation
in the pencil mode bar. Then the pencil or your finger operates as a mouse with a left button.
The control is available after the app sees an Apple Pencil, or when Draw with finger
is on. The first time that you turn it on, the app shows how it operates. To stop this message, select Don't show this again.
| You use | Move the pointer | Click |
|---|---|---|
| A pencil with hover | Hover above the screen. | Touch the screen. To drag, move the pencil while it touches the screen. |
| A pencil without hover | Draw lightly. | Press harder than the Click Pressure value. |
| A finger (Draw with finger | Move your finger. | Tap. To double-click, tap two times. To drag, tap one time. Then touch again and hold while you move. |
To set how hard you press for a click, use Click Pressure in Settings. To try the value, tap Test Click Pressure. A bar shows your pressure, and a line shows the click point.
Pressure and tilt curves
A curve changes the pressure or the tilt before the app sends it to the computer. For example, a curve can give more pressure for a light touch. The curves have an effect on the pencil only, not on a finger.
- Tap Curves
in the pencil mode bar. - Tap Pressure or Tilt.
- Tap the graph to add a point.
- Drag a point to change the curve.
The horizontal axis is the value from the pencil. The vertical axis is the value that the computer gets. The two end points do not move. To remove a point, tap it one time. The panel tells you to double-tap, but a second tap adds a new point. To remove all changes, tap Reset to Linear.
When a curve is not linear, the Curves
icon shows in the accent color. The curves are the same for all servers.
Pencil mode settings
To open the settings, tap Settings
in the pencil mode bar. Settings opens at the Pencil page. In a different mode, open Settings. Then tap Pencil. These settings are the same for all servers.
| Setting | What it does | Default |
|---|---|---|
| Disable Scribble | When you type to the computer, Apple Pencil handwriting does not replace the keyboard. | On |
| Rotate with Two Fingers | A turn of two fingers turns the preview. With it off, two fingers only zoom and move the preview. | On |
| Emulate Pressure with Finger | With Draw with finger | On |
| Sampling Rate | The lowest screen refresh rate of the iPad in pencil mode, from 15 to 120 Hz. A higher rate gives less input delay, but uses more power. It has an effect on an iPad with a 120 Hz screen. | 60 Hz |
| Stroke Prediction | Draws a white line on the iPad in front of the pencil tip. The line shows where the stroke will go. It hides the delay before the computer draws the stroke. The app does not send this line to the computer. | On |
| Prediction Distance | The longest predicted line, in points (20 to 150). Shows when Stroke Prediction is on. | 80 |
| Line Width Multiplier | The width of the predicted line (0.5 to 3.0). Shows when Stroke Prediction is on. | 1.0 |
| Click Pressure | In Mouse Emulation | 50% |
| Test Click Pressure | Opens a test area for Click Pressure. | |
| Double Tap | The action for a double tap on Apple Pencil. See Double tap and squeeze. | Undo |
| Squeeze | The action for a squeeze of Apple Pencil Pro. | Toggle Overlay |
| Frame Rate | In Screen Preview: how often the preview refreshes (10 to 60 fps). A higher rate is smoother, but uses more battery power and more network data. | 15 fps |
| Sharpen When Still | When the computer screen stops changing, the server sends the picture again with no compression. Then photographs and gradients become exact. It uses the network only while nothing moves. On a metered connection, turn it off. | On |
Two more settings are in the pencil mode bar, not on this page:
- Mouse emulation
is off by default. The app keeps your choice. - The pressure and tilt curves are linear by default.
App toolbar, buttons and overlays
Pencil mode also has the app toolbar, overlays and your own buttons. The app toolbar has the tools of the app in front. An overlay shows a part of the screen. Your own buttons send one or more actions. The chapter App toolbar, buttons and overlays tells you how to use them.
Tips
- Use a USB cable. For the best result in pencil mode, connect the iPad to the computer with a USB cable. See Connect with a USB cable.
- Keep Stroke Prediction on. The predicted line shows where the stroke goes before the computer draws it.
- Increase the Sampling Rate on an iPad with a 120 Hz screen. This gives the lowest input delay.
- Zoom the preview, not the app. For fine work, pinch to zoom the preview. The drawing app on the computer does not change.
- On a Mac, the first picture can be slow. macOS checks the screen recording permission of ilopad before the first picture. The server does this check when it starts and when a device connects. But the first picture can still take some seconds. Wait for it.
- On Windows, make sure that the drawing app uses Windows Ink. See A drawing app that cannot see the pen.