ilopad
Manual

Pencil mode

What pencil mode is

In pencil mode, the app shows a live picture of the computer screen. This manual calls this picture the screen preview. When you draw on the preview with Apple Pencil, the pen draws at the same point on the computer. Drawing apps on the computer get pen input with pressure and tilt, the same as from a graphics tablet.

Only an iPad with an Apple Pencil is a drawing tablet. Pencil mode is also in the app on an iPhone, but you cannot use an Apple Pencil with an iPhone. On an iPhone, you see the screen preview. When Draw with finger is on, you can draw with one finger.

Pencil mode on an iPad in landscape. The computer screen shows Krita with a painting of a robin. The pencil mode bar is at the top and the app toolbar for Krita is at the left.
Pencil mode on an iPad. The pencil mode bar is at the top. The app toolbar for the app in front (here, Krita) is at the left.

Start pencil mode

  1. Connect the app to the server. See Add a device to the server.
  2. In the toolbar, tap the mode button . It shows the icon of the current mode.
  3. Tap Pencil .
  4. Hold the iPad in landscape. On an iPhone, pencil mode turns the screen to landscape.

The server starts to send the screen when a device starts pencil mode. It stops when no device is in pencil mode.

What the computer asks the first time

To send the screen, the server must capture it. The first time, the computer can ask you for permission:

  • macOS: macOS must allow ilopad to record the screen. If it does not, the server shows the dialog ilopad cannot see this screen. For the steps, see ilopad cannot see this screen.
  • Linux (Wayland): the desktop shows its own screen share dialog. Select one screen and allow the share. The server asks the desktop to keep this choice for the next time.
  • Windows and Linux (X11): the computer asks nothing.
Server dialog titled ilopad cannot see this screen, with the buttons Close and Open System Settings.
On a Mac, the server shows this dialog until you allow screen recording.

If the app shows No screen to draw on or This server is too old, see Pencil mode shows no screen.

Select the screen

Pencil mode shows one screen of the computer. If the computer has more than one monitor, you can change the screen on the server:

  1. Open the server window on the computer.
  2. Click the screen button at the top of the window. Its tooltip is Change shared screen.
  3. Select the screen.

What you see after the click depends on the operating system. On Windows, you can also set the screen in the server settings. For each system, see The screen for pencil mode.

The button shows only when you can change the screen. The pen always draws on the screen that the preview shows.

Draw with Apple Pencil

Touch the preview with Apple Pencil and draw. The app sends these values to the computer:

  • Position. The point under the pencil tip, also when you zoom, move or turn the preview.
  • Pressure. How hard you press. The pressure curve changes this value before the app sends it to the computer.
  • Tilt. The angle of the pencil. The tilt is correct also when you turn the preview.
  • Barrel roll. How much you turn the pencil around its own axis. Only Apple Pencil Pro gives this value. It needs iPadOS 17.5 or later.
  • Hover. When you hold the pencil tip above the screen, the pointer on the computer follows it. This needs an iPad and an Apple Pencil that support hover.

Apple Pencil has no eraser end. ilopad does not send a pen eraser. To erase, select the eraser tool of the drawing app. To do this, you can set double tap to Eraser Toggle. You can also use the eraser button in the app toolbar.

What reaches the computer on each system

ValueLinuxmacOSWindows
PositionYesYesYes
PressureYes, all levelsYes, all levelsYes, with fewer levels
TiltYesYesYes
Barrel rollYesYesNo, with the pen tablet driver
HoverYesYesYes

On Windows, the ilopad installer adds a pen tablet driver. Windows gets fewer pressure levels than the iPad sends. The number of levels depends on the pen driver. The pen tablet driver does not send barrel roll.

If the computer does not have the pen tablet driver, the server shows this message: ilopad is not sending your pen as a tablet. Then drawing apps see a mouse and get no pressure. To add the driver, run the ilopad installer again.

Windows: a drawing app that cannot see the pen

Windows gives apps two ways to read a pen: Windows Ink and WinTab. The ilopad pen is a Windows Ink pen. Some drawing apps use WinTab by default. Then they cannot see the pen. When such an app is in front, the server shows a dialog. The dialog tells you how to correct the problem. At this time, the server checks Krita.

Server dialog titled Krita cannot see your pen. It tells you to select Windows 8+ Pointer Input (Windows Ink) in the Krita tablet settings.
The server tells you how to change Krita on Windows from WinTab to Windows Ink.

To test the pen without a drawing app, use the Pencil tab of the Input Testing window on the server. See Test the input: Pencil.

Use your fingers

With Draw with finger off, one finger on the preview sends nothing to the computer. You can use these gestures with two and three fingers:

GestureResult
Move two fingersMoves the preview.
Pinch two fingersZooms the preview in or out.
Turn two fingersTurns the preview. To stop this, turn off Rotate with Two Fingers in Settings.
Tap with two fingersSends Undo to the app on the computer.
Tap with three fingersSends Redo to the app on the computer.

The zoom, the move and the turn change only the preview on the iPad. They do not change the computer. To zoom the drawing app itself, use Pan the remote screen .

The two-finger tap and the three-finger tap send the undo and redo shortcut of the app in front. You cannot change these two gestures.

When two or more fingers touch the preview, a ring shows under each finger. The ring starts as a pulse of light, then it turns slowly. It shows you where the app reads your fingers. If Reduce Motion is on in iPadOS, the ring does not move.

Fit to Screen

Tap Fit to Screen in the pencil mode bar. The preview then shows all of the computer screen below the bar. Fit to Screen also makes a turned preview straight again.

Pan the remote screen

When Pan the remote screen is on in the pencil mode bar, two fingers move and zoom the drawing app on the computer, not the preview. The server sends the pan and zoom shortcuts of that app. A turn of two fingers then does nothing. When you leave pencil mode, the control turns off again.

The server knows the pan and zoom of these apps:

  • Pan and zoom: Krita, Inkscape, GIMP, Adobe Photoshop, Adobe Illustrator, Affinity, Clip Studio Paint, MediBang Paint, Adobe Fresco, Apple Freeform, Miro, Pixelmator Pro, Canva, Microsoft Whiteboard.
  • Zoom only: Goodnotes, Xodo, ArtRage.

In other apps, the gesture does nothing.

Draw with finger

Tap Draw with finger in the pencil mode bar. Then one finger draws as a pen. Two-finger and three-finger gestures continue to operate. A stroke starts a short time after the finger touches the screen. Thus the app can see if a second finger also touches.

With Emulate Pressure with Finger on, the app sets the pressure from the size of the finger contact. With it off, a finger always draws at full pressure. A finger sends no tilt.

The pencil mode bar

The bar at the top of pencil mode has these controls. Most controls are icons. The names below are the VoiceOver names.

ControlWhat it does
Disconnect, ConnectionEnds the connection, or shows the connection details. See Connection state.
TemplatesSaves and loads sets of buttons and overlays. See Templates.
Edit buttonsLets you add, move and change your buttons and overlays. See Edit mode.
Draw with fingerOne finger draws as a pen. See Draw with finger.
Mouse emulationThe pencil or a finger operates as a mouse. See Mouse emulation.
Pan the remote screenTwo fingers pan and zoom the app on the computer. See Pan the remote screen.
Fit to ScreenShows all of the computer screen, with no rotation.
CurvesOpens the pressure and tilt curves. See Pressure and tilt curves.
KeyboardOpens the keyboard. The app sends the text that you type to the computer.
SettingsOpens Settings at the Pencil page.
Mode buttonChanges the mode.
Hide toolbarHides the bar. To show it again, tap the tab at the top right corner (Show toolbar).

When the bar does not have sufficient space, Templates , Fit to Screen , Curves and Settings move into the More controls menu. The bar can also hide automatically after some seconds. See Auto-Hide in General settings.

Double tap and squeeze

You can set an action for two Apple Pencil gestures:

  • Double Tap: tap two times on the side of the pencil. This needs Apple Pencil (2nd generation) or Apple Pencil Pro. In ilopad it needs iPadOS 17.5 or later.
  • Squeeze: squeeze the pencil. This needs Apple Pencil Pro.

To change the action:

  1. Tap Settings in the pencil mode bar.
  2. In Apple Pencil Gestures, tap Double Tap or Squeeze.
  3. Tap an action in Presets. Or tap Custom Key Combo and select a key.
PresetWhat it does
UndoUndo. Default for Double Tap.
RedoRedo.
Eraser ToggleSelects the eraser of the app.
Brush ToggleSelects the brush of the app.
Pick ColorGets the color under the pointer. In Photoshop, Krita and some other apps, it holds the pick key and clicks. Thus the brush stays selected. In other apps, it selects the eyedropper tool.
Toggle OverlayHides or shows your overlays on the iPad. It sends nothing to the computer. Default for Squeeze.

A preset is an action, not a key. When ilopad knows the app in front, it sends the shortcut of that app for the action. When it does not know the app, it sends a standard key: Ctrl+Z for Undo, Ctrl+Shift+Z for Redo, E for the eraser, B for the brush, and Alt+click for the color. On a Mac, Command replaces Ctrl.

ilopad always sends a custom key as you selected it.

Shortcuts for the app in front

In pencil mode, the server tells the app which app is in front on the computer. To see this app, tap Connection in the pencil mode bar. The row Active App shows the name.

ilopad uses this information in these places:

  • The app toolbar at the left shows the tools and shortcuts of that app. See The app toolbar.
  • Double Tap, Squeeze and the two-finger and three-finger taps send the shortcut of that app.
  • Pan the remote screen uses the pan and zoom keys of that app.

The shortcuts are correct for the system of the computer. For example, Undo is Command+Z on a Mac and Ctrl+Z on Windows and Linux. If an app uses a different key on one system, ilopad sends the key for that system.

On Windows and macOS, the server sees the app in front. On Linux, this depends on the desktop. The server has support for KDE Plasma, GNOME, Sway, Hyprland and X11 desktops.

If ilopad does not know the app, you can select its toolbar by hand. See The app toolbar.

Mouse emulation

Some programs do not use pen input, for example many games. For these programs, turn on Mouse emulation in the pencil mode bar. Then the pencil or your finger operates as a mouse with a left button.

The control is available after the app sees an Apple Pencil, or when Draw with finger is on. The first time that you turn it on, the app shows how it operates. To stop this message, select Don't show this again.

You useMove the pointerClick
A pencil with hoverHover above the screen.Touch the screen. To drag, move the pencil while it touches the screen.
A pencil without hoverDraw lightly.Press harder than the Click Pressure value.
A finger (Draw with finger on)Move your finger.Tap. To double-click, tap two times. To drag, tap one time. Then touch again and hold while you move.

To set how hard you press for a click, use Click Pressure in Settings. To try the value, tap Test Click Pressure. A bar shows your pressure, and a line shows the click point.

Pressure and tilt curves

A curve changes the pressure or the tilt before the app sends it to the computer. For example, a curve can give more pressure for a light touch. The curves have an effect on the pencil only, not on a finger.

  1. Tap Curves in the pencil mode bar.
  2. Tap Pressure or Tilt.
  3. Tap the graph to add a point.
  4. Drag a point to change the curve.

The horizontal axis is the value from the pencil. The vertical axis is the value that the computer gets. The two end points do not move. To remove a point, tap it one time. The panel tells you to double-tap, but a second tap adds a new point. To remove all changes, tap Reset to Linear.

When a curve is not linear, the Curves icon shows in the accent color. The curves are the same for all servers.

The Curves panel over the screen preview, with the Pressure and Tilt tabs, a curve graph and the Reset to Linear button.
The Curves panel. Tap the graph to add a point. Drag a point to change the curve.

Pencil mode settings

To open the settings, tap Settings in the pencil mode bar. Settings opens at the Pencil page. In a different mode, open Settings. Then tap Pencil. These settings are the same for all servers.

The Pencil page of Settings with Disable Scribble, Rotate with Two Fingers, Emulate Pressure with Finger and Sampling Rate.
The Pencil page in Settings.
SettingWhat it doesDefault
Disable ScribbleWhen you type to the computer, Apple Pencil handwriting does not replace the keyboard.On
Rotate with Two FingersA turn of two fingers turns the preview. With it off, two fingers only zoom and move the preview.On
Emulate Pressure with FingerWith Draw with finger , sets the pressure from the size of the finger contact. With it off, a finger draws at full pressure.On
Sampling RateThe lowest screen refresh rate of the iPad in pencil mode, from 15 to 120 Hz. A higher rate gives less input delay, but uses more power. It has an effect on an iPad with a 120 Hz screen.60 Hz
Stroke PredictionDraws a white line on the iPad in front of the pencil tip. The line shows where the stroke will go. It hides the delay before the computer draws the stroke. The app does not send this line to the computer.On
Prediction DistanceThe longest predicted line, in points (20 to 150). Shows when Stroke Prediction is on.80
Line Width MultiplierThe width of the predicted line (0.5 to 3.0). Shows when Stroke Prediction is on.1.0
Click PressureIn Mouse Emulation , for a pencil without hover: how hard you press for a click (5% to 95%). A lighter touch moves the pointer.50%
Test Click PressureOpens a test area for Click Pressure.
Double TapThe action for a double tap on Apple Pencil. See Double tap and squeeze.Undo
SqueezeThe action for a squeeze of Apple Pencil Pro.Toggle Overlay
Frame RateIn Screen Preview: how often the preview refreshes (10 to 60 fps). A higher rate is smoother, but uses more battery power and more network data.15 fps
Sharpen When StillWhen the computer screen stops changing, the server sends the picture again with no compression. Then photographs and gradients become exact. It uses the network only while nothing moves. On a metered connection, turn it off.On

Two more settings are in the pencil mode bar, not on this page:

  • Mouse emulation is off by default. The app keeps your choice.
  • The pressure and tilt curves are linear by default.

App toolbar, buttons and overlays

Pencil mode also has the app toolbar, overlays and your own buttons. The app toolbar has the tools of the app in front. An overlay shows a part of the screen. Your own buttons send one or more actions. The chapter App toolbar, buttons and overlays tells you how to use them.

Tips

  • Use a USB cable. For the best result in pencil mode, connect the iPad to the computer with a USB cable. See Connect with a USB cable.
  • Keep Stroke Prediction on. The predicted line shows where the stroke goes before the computer draws it.
  • Increase the Sampling Rate on an iPad with a 120 Hz screen. This gives the lowest input delay.
  • Zoom the preview, not the app. For fine work, pinch to zoom the preview. The drawing app on the computer does not change.
  • On a Mac, the first picture can be slow. macOS checks the screen recording permission of ilopad before the first picture. The server does this check when it starts and when a device connects. But the first picture can still take some seconds. Wait for it.
  • On Windows, make sure that the drawing app uses Windows Ink. See A drawing app that cannot see the pen.