E-Paper module to replace spacers in palm rest

This is very much work-in-progress but maybe it is already interesting for some of you.

The design files are here but there are some errata, e.g. SPI pinout is wrong on the flex PCB:

In short: We sneak a flex PCB below the macro pad to connect to the 2nd set of pogo pins. The flex PCB has pads for an RP2040-tiny board and it has the important parts of Waveshare’s adapter board for their 3.7’’ ePaper. We add a resistive touch screen and maybe an APDS-9960 gesture sensor.

On the software side, my hope is that we can add a headless output to Sway and mirror that to the ePaper.

Current issues:

  • The flex PCB works quite well but it is a bit cumbersome to install because you have to align it before installing the macro pad module. I’m not sure that this can be improved. The challenging parts are (a) we have to align to the pogo pins and (b) distance to the pogo pins changes when we move the module into place.
  • There isn’t much space in the vertical direction. The current module is 1mm higher than the normal palm rest and we also need a few mm more towards the keys. We will have to find a better touchscreen module to improve this.
  • I would like to add some security functions to the module (FIDO2 with UI, password manager) but that doesn’t make much sense with RP2040, which omits trusted boot to be unbrickable.
  • The PCB design has a few errata: SPI pinout, pitch of touchscreen connector, length of connector to the pogo pins.
22 Likes

Just to share more in formation in hopes it may help in some way, it seems Framework made a mock for one which would be in place of the macro/ num pad instead of below it. (Video posted March 25th, 2023)

I am not sure if anything more has been shared outside of it in this video or designs for it shared;

YouTube Video - Timestamp 8:29

2 Likes

That looks like a Palm Pilot hacked in there.

Now if it has a resistive screen and can be used with pen to input letters and numbers via the good ol’ Palm input method “Graffiti” as well as general purpose display… woohoo!

1 Like

This looks AMAZING! Please keep updating us!!! I’d buy this!

1 Like

Because of the way you are having to connect I presume this can only go on the left of the touchpad as illustrated, or are you thinking there could be another version that could go to the right?

definitely keeping an eye on this

does this have to go under the macro pad, or can it be any module?

This is awesome, and if you DO manage to successfully integrate this, I hope Framework staff takes notice, cuz this is pretty sick

@BulletzQS Yeah, I’ve seen it in this thread. I’m taking the complicated route because I want to keep the macro pad :wink:

@Axel_Hartmann Hehe. I like that idea. Not so useful next to a full keyboard but I might add it anyway. Do you know of any FOSS software that already implements the Palm input method?

You will need a free set of pogo pins with USB. In practice, this means that it is best placed below a double-width module like the macro pad or numpad. I think all of them have must use the USB pads on the left because of how the config resistors are defined, so the right ones are likely free.

@Alan_Pearce Yes, this means that it can be on the right side.

There are additional pogo pins that are covered by the touchpad module. The three in the middle have I2C and are not useful for this module but I think you could swap epaper and touchpad while keeping the macropad to the left. You could also try more creative ways and 3D print a smaller touchpad module.

@TheLPeink @Iron_Raptor I don’t think that this will ever be viable as a product to be sold. The original Framework modules are easy to install and hard to misuse. Their spec isn’t meant to allow this kind of module (which is exactly why I wanted to try it anyway :wink: ). It will never be as robust and you can certainly break things if you misalign the flex cable. Thus, customer support would be a nightmare.

Nonetheless, I’m publishing all the design files as usual so anyone can build it and modify to suit their needs. I suggest that you ask at hackerspace/makerspace/Fablab in your area if you need help with soldering and 3D printing the parts. I expect that the cost will be 30-80€ — depending on whether you find someone to pool orders (e.g. you cannot order fewer than five flex PCBs).

3 Likes

Awesome. :bowing_man:
Which touch overlay did you use?

One of the 4.3’’ variants here:

https://www.aliexpress.com/item/1005002841077197.html

The size is not really right and I would like to find a thinner one. Do you have any suggestions on where to buy them? My search on Ali and Ebay was mostly like “open a lot of tabs, hope that they have dimensions somewhere (many don’t), repeat until too frustrated and then buy one that maybe, sort-of works”.

(Edit: And I haven’t found any that specify the pitch of the connector, so I had to guess.)

I just found another small issue: My plan was to also have this working outside of Framework (if only for debugging) but 3.3V for the epaper is not connected when using the RP2040-tiny to USB adapter.

We can close JP4 to fix this but then it shouldn’t be used with the laptop anymore because then two source would be driving that power supply. D’oh!


I just re-printed the outer part of the module, so that’s a good moment to take more photos. This is how it looks from behind:

You can see that the flex PCB is bent when installing the module. This probably won’t survive hundreds of times but so far it is holding up great.

Installing the module becomes easier if we apply a piece of tape. I should have thought of this earlier :smiley: (It is transparent tape so not so easy to see here.)

3 Likes

Looks quite cool, its something I might be interested in depending on what could be done with it.

very cool! I’d love to see this for the '13 if that’s possible (I’m new Framework)

No, not really. Only 16’’ has this module system. You can add this to any laptop, in theory, but it will be more work. Framework 13 might be slightly easier than others because of good documentation, easy access to replacement parts and you could use a dongle hider extension card to connect it to USB.


Status update: We can add it as an additional output to Sway:

We are using dithering to simulate additional levels of gray beyond the four that are supported by the display. You can probably not at all in the photo but it is clearly visible in the debug images:

eog with dithering

There are some downsides: First, mako may decide to show notifications on the epaper if we position it to the right of the main display (workaround: move it to the left):

Second, it will be locked together with the main screen. Here’s swaylock on the epaper (please excuse the bad lighting):

This might be exactly what you want, e.g. if you use it as a 2nd screen and there could be private information. My plan is to use this as a status display and it should remain available when the main screen is locked.

swaylock used to support transparency, which would solve this rather nicely, but not anymore (for very valid security reasons - not supporting transparency anymore is just an unintended consequence).

We do have a rather hacky workaround: Run a nested Sway session with X11 backend. The downside is that we cannot move a running application to the epaper without restarting it.

1 Like