Take a look at our
ThinkPads.com HOME PAGE
For those who might want to contribute to the blog, start here: Editors Alley Topic
Then contact Bill with a Private Message
ThinkPads.com HOME PAGE
For those who might want to contribute to the blog, start here: Editors Alley Topic
Then contact Bill with a Private Message
ExpressCard USB3 adapters - read speed issue [SOLVED]
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
I am currently in the process of investigating yet another ExpressCard adapter, with ASMedia chipset (this, among other things, is what delaying my USB3 review ).
I'll see what conclusions I reach. If only I had a personal X220 to test it on.
I'll see what conclusions I reach. If only I had a personal X220 to test it on.
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
I'm using the Renasas based Transcend card,
http://www.amazon.com/Transcend-Express ... xpresscard
on a W500 running W7, and a T400 running W8.
On the W500, the throughput is quite decent, CrystalMark ~90 MB/s, real world ~ 65MB/s
On the T400 with W8, real world ~ 15 MB/s, slower than USB 2.0 on the same machine.
The Renasas card was not originally recognized under W8, but a driver update this year fixed that. Unfortunately, it is so slow under W8, there is no reason to use the card.
The construction of the card is adequate IMHO, though it is practically necessary to plug/unplug the USB cable with the card removed from the machine. A 34mm card in a 54 mm slot is simply not rigid enough otherwise.
http://www.amazon.com/Transcend-Express ... xpresscard
on a W500 running W7, and a T400 running W8.
On the W500, the throughput is quite decent, CrystalMark ~90 MB/s, real world ~ 65MB/s
On the T400 with W8, real world ~ 15 MB/s, slower than USB 2.0 on the same machine.
The Renasas card was not originally recognized under W8, but a driver update this year fixed that. Unfortunately, it is so slow under W8, there is no reason to use the card.
The construction of the card is adequate IMHO, though it is practically necessary to plug/unplug the USB cable with the card removed from the machine. A 34mm card in a 54 mm slot is simply not rigid enough otherwise.
W500x3 with T9900, , T400 highnit 1280x800 with P9600, X61sx3, X61Tx3.
-
- Posts: 2
- Joined: Fri Sep 20, 2013 10:36 pm
- Location: Saint Paul, MN
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
dr_st - I signed up for the forum just to THANK YOU for this thread :-).
I have been struggling for some time with an x220 tablet, flush usb 3 express cards and nothing but dodgy, erratic behavior. I had not thought about power saving features at the PCI level because the symptoms didn't line up for me, but after reading this, changing the BIOS to disable power saving on PCI fixed the issue totally. Awesome.
Details in case someone else has this issue:
x220 tablet, Windows 8, both Startech and AKE NECXG USB3 Express cards (I bought another thinking the first was bad, but it looks like they have the same chip set. Turns out they both work fine). External USB 3 disk enclosure with a Crucial SSD, used for VHDs for a small VM lab.
Behavior with default BIOS settings:
Boot, then plug the Express card in - machine becomes sluggish, System process uses more CPU than normal, erratic mouse movement, stuttering sound.
Remove the card, machine works normally.
Put the card back in, but then reboot with it in place - everything works, including the card, external HDD.
Try to eject and then physically unplug the external hard drive from the express card, the card pops out of the laptop ('natch.) Junk, flimsy mechanical connection holding the card in has less grip than the USB plug. Result: same sluggish symptoms, slow mouse movement, stuttering sound.
Reboot, back to normal.
Sleep and then wake (or close and open) the machine with the card in causes the same problem.
Changing the BIOS setting for power saving on PCI seems to have solved the issue totally - I can plug and unplug the card, and the USB driver loads correctly and the machine works now (which is handy given the cards' tendency to pop out!)
I have been struggling for some time with an x220 tablet, flush usb 3 express cards and nothing but dodgy, erratic behavior. I had not thought about power saving features at the PCI level because the symptoms didn't line up for me, but after reading this, changing the BIOS to disable power saving on PCI fixed the issue totally. Awesome.
Details in case someone else has this issue:
x220 tablet, Windows 8, both Startech and AKE NECXG USB3 Express cards (I bought another thinking the first was bad, but it looks like they have the same chip set. Turns out they both work fine). External USB 3 disk enclosure with a Crucial SSD, used for VHDs for a small VM lab.
Behavior with default BIOS settings:
Boot, then plug the Express card in - machine becomes sluggish, System process uses more CPU than normal, erratic mouse movement, stuttering sound.
Remove the card, machine works normally.
Put the card back in, but then reboot with it in place - everything works, including the card, external HDD.
Try to eject and then physically unplug the external hard drive from the express card, the card pops out of the laptop ('natch.) Junk, flimsy mechanical connection holding the card in has less grip than the USB plug. Result: same sluggish symptoms, slow mouse movement, stuttering sound.
Reboot, back to normal.
Sleep and then wake (or close and open) the machine with the card in causes the same problem.
Changing the BIOS setting for power saving on PCI seems to have solved the issue totally - I can plug and unplug the card, and the USB driver loads correctly and the machine works now (which is handy given the cards' tendency to pop out!)
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
Hi onupdatecascade,
Glad this thread could help you.
Unfortunately you may be sacrificing quite a bit battery life with disabling all PCIe power management features.
If you find the battery life drop unacceptable, consider using an automatic script to run something like setpci and turn it off specifically for the ExpressCard root port.
Glad this thread could help you.
Unfortunately you may be sacrificing quite a bit battery life with disabling all PCIe power management features.
If you find the battery life drop unacceptable, consider using an automatic script to run something like setpci and turn it off specifically for the ExpressCard root port.
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
-
- Posts: 2
- Joined: Fri Sep 20, 2013 10:36 pm
- Location: Saint Paul, MN
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
That might be a bit out of my depth (not a very accomplished hardware/driver guy :-). If the battery really becomes a problem I'll try to figure that out. Thanks again.
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
dr_st THANK YOU FOR YOUR WORK!dr_st wrote:I am currently in the process of investigating yet another ExpressCard adapter, with ASMedia chipset (this, among other things, is what delaying my USB3 review ).
I'll see what conclusions I reach. If only I had a personal X220 to test it on.
But i haven't this problems at all. I have ASMedia USB3 / ESATA3 combo card (ESATA -> USB Hub -> ASMedia XHCI) AKE branded from China
To examine your findings i have lspcied my T61 frankenpad with Middleton's BIOS... And ALL ASPM is disabled on PCIe root (for ExpressCard) and XHCI. I have rebooted and suspended | restored dozen times with card in notebook and all ok. This evening i'll test speed on my USB3 2.5" HDD. I can try to use SDD in USB3 enclosure to test for more agressive speed tests...
PS
And i want to test setpci to enable powersaving on this controller because i use it not wery often...
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
Yes, from all the cards I tested, only the Renesas ones triggered ASPM on the root port. ASMedia/Fresco did not, so your findings are consistent with mine.
Furthermore, I suspect that if you try to enable ASPM (esp. L0s) on your ASMedia card, you will run into issues with it working at all.
Furthermore, I suspect that if you try to enable ASPM (esp. L0s) on your ASMedia card, you will run into issues with it working at all.
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
-
- Sophomore Member
- Posts: 182
- Joined: Tue Jun 24, 2008 11:16 am
- Location: France (most of the time)
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
@dr_st,
Could you give me a hand? I fail to set it properly on my card. The card's PCI ID is: 1912:0015
and so
lspci -vvv:
and
therefore I verify it:
and so I change it and verify
but the change never occurs.
What am I doing wrong?
Could you give me a hand? I fail to set it properly on my card. The card's PCI ID is: 1912:0015
and so
lspci -vvv:
Code: Select all
00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev 93) (prog-if 01 [Subtractive decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Bus: primary=00, secondary=15, subordinate=18, sec-latency=32
I/O behind bridge: 00005000-00008fff
Memory behind bridge: fa000000-fc0fffff
Prefetchable memory behind bridge: 00000000f0000000-00000000f3ffffff
Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity- SERR- NoISA+ VGA- MAbort- >Reset- FastB2B-
PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
Capabilities: [50] Subsystem: Lenovo Device 20f4
05:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02) (prog-if 30 [XHCI])
Physical Slot: 3
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 19
Region 0: Memory at f4800000 (64-bit, non-prefetchable) [size=8K]
Capabilities: [50] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [70] MSI: Enable- Count=1/8 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [90] MSI-X: Enable+ Count=8 Masked-
Vector table: BAR=0 offset=00001000
PBA: BAR=0 offset=00001080
Capabilities: [a0] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
LnkCap: Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <4us, L1 unlimited
ClockPM+ Surprise- LLActRep- BwNot-
LnkCtl: ASPM L0s L1 Enabled; RCB 64 bytes Disabled- CommClk+
ExtSynch- ClockPM+ AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Not Supported, TimeoutDis+, LTR+, OBFF Not Supported
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
Capabilities: [100 v1] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
Capabilities: [150 v1] Latency Tolerance Reporting
Max snoop latency: 0ns
Max no snoop latency: 0ns
Kernel driver in use: xhci_hcd
Kernel modules: xhci_hcd
Code: Select all
lspci -d 1912:0015 -xxx
05:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)
00: 12 19 15 00 06 05 10 00 02 30 03 0c 10 00 00 00
10: 04 00 80 f4 00 00 00 00 00 00 00 00 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 ff ff ff ff
30: 00 00 00 00 50 00 00 00 00 00 00 00 0b 01 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 01 70 c3 c9 08 00 00 00 00 00 00 00 00 00 00 00
60: 30 20 00 00 00 00 00 00 00 00 00 00 09 24 20 00
70: 05 90 86 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 11 a0 07 80 00 10 00 00 80 10 00 00 00 00 00 00
a0: 10 00 02 00 c0 8f 00 00 00 28 19 00 12 ec 07 00
b0: 43 01 11 10 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 10 08 00 00 00 00 00 00 00 00 00 00
d0: 02 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 03 00 00 00 01 05 12 30 ef 00
f0: 00 00 00 00 00 00 00 80 00 00 00 00 00 00 00 00
Code: Select all
setpci -d 1912:0015 50.b
01
Code: Select all
# setpci -d 1912:0015 50.b=42
# setpci -d 1912:0015 50.b
01
What am I doing wrong?
T420s - i7, 16GB RAM, Samsung 850 EVO + 1TB Hitachi 9.5mm, Nvidia, Oleh Bios.
W500 - C2D P9500, 8GB RAM, Samsung 830 SSD + 750GB Hitachi HDD, Intel+ATI GPU, bright WUXGA, FP-reader
Arch Linux, BTRFS+ZFS on LUKS
W500 - C2D P9500, 8GB RAM, Samsung 830 SSD + 750GB Hitachi HDD, Intel+ATI GPU, bright WUXGA, FP-reader
Arch Linux, BTRFS+ZFS on LUKS
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
You are not supposed to do it on the card, but rather on the PCIe root port that the card sits under.
You can run lspci -t to verify. It will look like this (this is from my desktop, so the details are different):
C:\>lspci
00:01.0 PCI bridge: Intel Corporation 4 Series Chipset PCI Express Root Port (rev 02)
00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1
00:1c.5 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 6
03:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03)
( I removed all the devices except the root ports and the USB3 controller)
C:\>lspci -t
-[0000:00]-+-00.0
+-01.0-[01]--+-00.0
| \-00.1
+-1a.0
+-1a.1
+-1a.2
+-1a.7
+-1c.0-[03]----00.0
+-1c.5-[02]----00.0
+-1d.0
+-1d.1
+-1d.2
+-1d.7
+-1e.0-[04]--+-00.0
| +-01.0
| \-03.0
+-1f.0
+-1f.2
\-1f.3
This tells you that the device on Bus:Device.Function 3:0.0 (which is the USB3 controller in my case) sits under device 0:1c.0 (which in my case is PCIe root port 1).
So in my case I would do:
setpci -s 0:1c.0 50.b
And if it comes back as 43 (L0s/L1 Enabled), I would change it:
setpci -s 0:1c.0 50.b=42
If you also which to change the settings on the controller itself, then the offset is not 0x50, but 0xB0 (check the -xxx printout).
So it would be:
setpci -d 1912:0015 b0.b=42
You can run lspci -t to verify. It will look like this (this is from my desktop, so the details are different):
C:\>lspci
00:01.0 PCI bridge: Intel Corporation 4 Series Chipset PCI Express Root Port (rev 02)
00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1
00:1c.5 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 6
03:00.0 USB controller: Renesas Technology Corp. uPD720201 USB 3.0 Host Controller (rev 03)
( I removed all the devices except the root ports and the USB3 controller)
C:\>lspci -t
-[0000:00]-+-00.0
+-01.0-[01]--+-00.0
| \-00.1
+-1a.0
+-1a.1
+-1a.2
+-1a.7
+-1c.0-[03]----00.0
+-1c.5-[02]----00.0
+-1d.0
+-1d.1
+-1d.2
+-1d.7
+-1e.0-[04]--+-00.0
| +-01.0
| \-03.0
+-1f.0
+-1f.2
\-1f.3
This tells you that the device on Bus:Device.Function 3:0.0 (which is the USB3 controller in my case) sits under device 0:1c.0 (which in my case is PCIe root port 1).
So in my case I would do:
setpci -s 0:1c.0 50.b
And if it comes back as 43 (L0s/L1 Enabled), I would change it:
setpci -s 0:1c.0 50.b=42
If you also which to change the settings on the controller itself, then the offset is not 0x50, but 0xB0 (check the -xxx printout).
So it would be:
setpci -d 1912:0015 b0.b=42
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
-
- Sophomore Member
- Posts: 182
- Joined: Tue Jun 24, 2008 11:16 am
- Location: France (most of the time)
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
Alright, I think I have it working. Thanks.
But why would I want to change the setting on the controller (you mean the USB card itself?) if the only one important is on the Intel bridge?dr_st wrote:If you also which to change the settings on the controller itself, then the offset is not 0x50, but 0xB0 (check the -xxx printout).
T420s - i7, 16GB RAM, Samsung 850 EVO + 1TB Hitachi 9.5mm, Nvidia, Oleh Bios.
W500 - C2D P9500, 8GB RAM, Samsung 830 SSD + 750GB Hitachi HDD, Intel+ATI GPU, bright WUXGA, FP-reader
Arch Linux, BTRFS+ZFS on LUKS
W500 - C2D P9500, 8GB RAM, Samsung 830 SSD + 750GB Hitachi HDD, Intel+ATI GPU, bright WUXGA, FP-reader
Arch Linux, BTRFS+ZFS on LUKS
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
I see no reason why you should, at least for the issue described here.Lockheed wrote:But why would I want to change the setting on the controller (you mean the USB card itself?) if the only one important is on the Intel bridge?
I've seen some other issues with this card (mostly talking about the terrible lag on Sandy Bridge system) where it felt like I really had to change the settings on both ends, otherwise they kept coming back. But I haven't investigated it fully.
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
Thanks a lot for this thread. It confirms that I was right to suspect that the generic USB3 Expresscard I've had in my X220 was the cause of intermittent, severe system, mouse and keyboard slowdowns and freezes under Ubuntu 14.04 64-bit. My fix is that I will simply leave the card out of the slot unless I actually need to use it - I've only one USB3 drive that I use for occasional backups.
If anyone's interested, the card I have is a 54mm one, with two USB3 slots and a power outlet jack between them. lspci provides the following info:
If anyone's interested, the card I have is a 54mm one, with two USB3 slots and a power outlet jack between them. lspci provides the following info:
05:00.0 USB controller: ASMedia Technology Inc. ASM1042 SuperSpeed USB Host Controller (prog-if 30 [XHCI])
Subsystem: Device 174c:2104
Physical Slot: 1
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 19
Region 0: Memory at f1c00000 (64-bit, non-prefetchable)
Capabilities: [50] MSI: Enable- Count=1/8 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [68] MSI-X: Enable+ Count=8 Masked-
Vector table: BAR=0 offset=00002000
PBA: BAR=0 offset=00002080
Capabilities: [78] Power Management version 3
Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold-)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [80] Express (v2) Legacy Endpoint, MSI 00
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <2us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 512 bytes
DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
LnkCap: Port #1, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s unlimited, L1 unlimited
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR-, OBFF Not Supported
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
Capabilities: [100 v1] Virtual Channel
Caps: LPEVC=0 RefClk=100ns PATEntryBits=1
Arb: Fixed- WRR32- WRR64- WRR128-
Ctrl: ArbSelect=Fixed
Status: InProgress-
VC0: Caps: PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
Arb: Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
Ctrl: Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
Status: NegoPending- InProgress-
Kernel driver in use: xhci_hcd
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
That's interesting information. Previously I encountered such symptoms only on Renesas cards, not ASMedia. But I think the reason was that only Renesas was, for some reason, turning L0s on by default. If I turned it on manually for the ASMedia, strange things did happen. It is possible, I guess, that on Ubuntu, the driver messes with the L-states from time to time, causing the issues you have been experiencing, although without further investigation I cannot pinpoint the issue.
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
This is confirmed to work with a no-name Renesas upd720202 under 64-bit Windows 7 on a T520. Funny enough, before this fix, the adapter wouldn't provide enough juice to spin up an external HD in an unpowered USB enclosure. Post-fix it powers up just fine.
With the T520, the relevant bus is 00:1c.3
Startup command: setpci -s 00:1c.3 50.b=42 (sure enough it was 43 before the command was run)
With the T520, the relevant bus is 00:1c.3
Startup command: setpci -s 00:1c.3 50.b=42 (sure enough it was 43 before the command was run)
-
- Sophomore Member
- Posts: 137
- Joined: Sun May 04, 2008 2:26 pm
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
I have several question due to a lack of knowledge. I came here in order to enable aspm features so that I can save a few watts, both while plugged in and on battery. I run server2012 on a x201. I learnt that aspm is not enabled on windows with the famous error, from powercfg -energy
http://forum.notebookreview.com/threads ... on.606100/
In this thread, you try to disable aspm, but I think I can learn a few things from it, because I have also a AKE card with chipset NEC Renesas uPD720202.
The card was furnished with a cd for the drivers, but windwos 2012 managed to install its own drivers.
this is the list of files on the CD from the vendor
http://abload.de/image.php?img=listefic ... ek3rpc.png
http://abload.de/image.php?img=renesasd ... 03xpyd.png
my first question is : should I install the drivers from the vendor or just use the driver from windows or even newer drivers ?
with the driver from windows, I have the following speed
http://abload.de/image.php?img=patriotu ... d8fo1y.png
http://abload.de/image.php?img=patriotu ... 2nto1i.png
http://abload.de/image.php?img=zalmanus ... so4pjj.png
http://abload.de/image.php?img=seagateu ... eqkpwk.png
http://abload.de/image.php?img=seagateu ... e1erxg.png
http://abload.de/image.php?img=seagateu ... fzqrp2.png
http://abload.de/image.php?img=lacieusb ... fdyo5p.png
http://abload.de/image.php?img=lacieusb ... fgtobl.png
http://abload.de/image.php?img=lacieusb ... e10p89.png
Are they normal/expected ? Can they be better ?
Next, I want to enable this L1/L0 thing for the express card, to see how much the performance decreases and how much power I save.
How can I do this ? How do I calculate the value to enter to enable/disable the L1/L0 feature?
Next, I want to enable L1/L0 for all pcie devices listed by lspci -nn
it turns out that the devices for which L0/L1 are not enabled are
05:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller [1912:0015] (rev 02)
and
00:1c.0 PCI bridge [0604]: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 [8086:3b42] (rev 06)
but apparently, the setting is lost after standby, which I use a lot. People say that RWEverything or that egup setup can do this, like here http://forum.notebookreview.com/threads ... st-7759675
but I have no idea what to do.
this is the overview of the config with the expresscard plugged in. It seems that it must be the root which must have l0/L1 disabled or enabled., but mine is already enabled and yet I do not seem to get the lack of speed...
this is the root port 1 which does not have the aspm enabled
this is the expresscard which does not have the aspm enabled
I have run the commands
to enable L1, but even after a powercfg -energy, I still get this
there is also something odd, because my audio chip has no asmp feature reported
is this normal ?
the solution is here, but I do not want to install grub, because I do not want to have another bootloader and all, at least not before I try solutions not involving this install.Platform Power Management Capabilities:PCI Express Active-State Power Management (ASPM) Disabled
PCI Express Active-State Power Management (ASPM) has been disabled due to a known incompatibility with the hardware in this computer.
http://forum.notebookreview.com/threads ... on.606100/
In this thread, you try to disable aspm, but I think I can learn a few things from it, because I have also a AKE card with chipset NEC Renesas uPD720202.
The card was furnished with a cd for the drivers, but windwos 2012 managed to install its own drivers.
this is the list of files on the CD from the vendor
http://abload.de/image.php?img=listefic ... ek3rpc.png
http://abload.de/image.php?img=renesasd ... 03xpyd.png
my first question is : should I install the drivers from the vendor or just use the driver from windows or even newer drivers ?
with the driver from windows, I have the following speed
http://abload.de/image.php?img=patriotu ... d8fo1y.png
http://abload.de/image.php?img=patriotu ... 2nto1i.png
http://abload.de/image.php?img=zalmanus ... so4pjj.png
http://abload.de/image.php?img=seagateu ... eqkpwk.png
http://abload.de/image.php?img=seagateu ... e1erxg.png
http://abload.de/image.php?img=seagateu ... fzqrp2.png
http://abload.de/image.php?img=lacieusb ... fdyo5p.png
http://abload.de/image.php?img=lacieusb ... fgtobl.png
http://abload.de/image.php?img=lacieusb ... e10p89.png
Are they normal/expected ? Can they be better ?
Next, I want to enable this L1/L0 thing for the express card, to see how much the performance decreases and how much power I save.
How can I do this ? How do I calculate the value to enter to enable/disable the L1/L0 feature?
Next, I want to enable L1/L0 for all pcie devices listed by lspci -nn
it turns out that the devices for which L0/L1 are not enabled are
05:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller [1912:0015] (rev 02)
and
00:1c.0 PCI bridge [0604]: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 [8086:3b42] (rev 06)
but apparently, the setting is lost after standby, which I use a lot. People say that RWEverything or that egup setup can do this, like here http://forum.notebookreview.com/threads ... st-7759675
but I have no idea what to do.
this is the overview of the config with the expresscard plugged in. It seems that it must be the root which must have l0/L1 disabled or enabled., but mine is already enabled and yet I do not seem to get the lack of speed...
Code: Select all
C:\Windows\System32>lspci -t
-[0000:00]-+-00.0
+-02.0
+-16.0
+-19.0
+-1a.0
+-1b.0
+-1c.0-[0d]--
+-1c.3-[05-0c]----00.0
+-1c.4-[02]----00.0
+-1d.0
+-1e.0-[0e]--
+-1f.0
+-1f.2
+-1f.3
\-1f.6
C:\Windows\System32>lspci -nn
00:00.0 Host bridge [0600]: Intel Corporation Core Processor DRAM Controller [8086:0044] (rev 02)
00:02.0 VGA compatible controller [0300]: Intel Corporation Core Processor Integrated Graphics Controller [8086:0046] (rev 02)
00:16.0 Communication controller [0780]: Intel Corporation 5 Series/3400 Series Chipset HECI Controller [8086:3b64] (rev 06)
00:19.0 Ethernet controller [0200]: Intel Corporation 82577LM Gigabit Network Connection [8086:10ea] (rev 06)
00:1a.0 USB controller [0c03]: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller [8086:3b3c] (rev 06)
00:1b.0 Audio device [0403]: Intel Corporation 5 Series/3400 Series Chipset High Definition Audio [8086:3b56] (rev 06)
00:1c.0 PCI bridge [0604]: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 [8086:3b42] (rev 06)
00:1c.3 PCI bridge [0604]: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 4 [8086:3b48] (rev 06)
00:1c.4 PCI bridge [0604]: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 5 [8086:3b4a] (rev 06)
00:1d.0 USB controller [0c03]: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller [8086:3b34] (rev 06)
00:1e.0 PCI bridge [0604]: Intel Corporation 82801 Mobile PCI Bridge [8086:2448] (rev a6)
00:1f.0 ISA bridge [0601]: Intel Corporation QM57 Chipset LPC Interface Controller [8086:3b07] (rev 06)
00:1f.2 SATA controller [0106]: Intel Corporation 5 Series/3400 Series Chipset 6 port SATA AHCI Controller [8086:3b2f] (rev 06)
00:1f.3 SMBus [0c05]: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller [8086:3b30] (rev 06)
00:1f.6 Signal processing controller [1180]: Intel Corporation 5 Series/3400 Series Chipset Thermal Subsystem [8086:3b32] (rev 06)
02:00.0 Network controller [0280]: Intel Corporation Centrino Advanced-N 6200 [8086:4239] (rev 35)
05:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller [1912:0015] (rev 02)
this is the root port 1 which does not have the aspm enabled
Code: Select all
C:\Windows\System32>lspci -d 8086:3b42 -xxx
00:1c.0 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 (rev 06)
00: 86 80 42 3b 04 01 10 00 06 00 04 06 10 00 81 00
10: 00 00 00 00 00 00 00 00 00 0d 0d 00 f0 00 00 20
20: f0 ff 00 00 f1 ff 01 00 00 00 00 00 00 00 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 14 01 04 00
40: 10 80 42 01 00 80 00 00 00 00 10 00 11 4c 11 01
50: 00 00 01 10 00 b2 04 00 00 00 00 00 00 00 00 00
60: 00 00 00 00 16 00 00 00 00 00 00 00 00 00 00 00
70: 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 05 90 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 0d a0 00 00 aa 17 64 21 00 00 00 00 00 00 00 00
a0: 01 00 02 c8 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 10 00 00 02 00 00 00 00 00 11 00 00 00 00 00
e0: 00 00 00 00 06 07 08 00 30 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 87 0f 07 08 00 00 00 00
Code: Select all
C:\Windows\System32>lspci -d 1912:0015 -xxx
05:00.0 USB controller: Renesas Technology Corp. uPD720202 USB 3.0 Host Controller (rev 02)
00: 12 19 15 00 06 05 10 00 02 30 03 0c 10 00 00 00
10: 04 00 f0 f1 00 00 00 00 00 00 00 00 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 ff ff ff ff
30: 00 00 00 00 50 00 00 00 00 00 00 00 00 01 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 01 70 c3 c9 08 00 00 00 00 00 00 00 00 00 00 00
60: 30 20 00 00 00 00 00 00 00 00 00 00 09 20 20 00
70: 05 90 86 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 11 a0 07 80 00 10 00 00 80 10 00 00 00 00 00 00
a0: 10 00 02 00 c0 8f 00 00 00 28 19 00 12 ec 07 00
b0: 00 00 11 10 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 10 08 00 00 00 00 00 00 00 00 00 00
d0: 02 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 03 00 00 00 01 05 13 20 c2 00
f0: 00 00 00 00 00 00 00 80 00 00 00 00 00 00 00 00
Code: Select all
setpci -s 0:1c.0 50.b=43
>setpci -d 1912:0015 b0.b=43
Platform Power Management Capabilities:PCI Express Active-State Power Management (ASPM) Disabled
PCI Express Active-State Power Management (ASPM) has been disabled due to a known incompatibility with the hardware in this computer.
there is also something odd, because my audio chip has no asmp feature reported
is this normal ?
Code: Select all
00:1b.0 Audio device: Intel Corporation 5 Series/3400 Series Chipset High Definition Audio (rev 06)
Subsystem: Lenovo Device 215e
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin B routed to IRQ 17
Region 0: Memory at f2520000 (64-bit, non-prefetchable)
Capabilities: [50] Power Management version 2
Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [60] MSI: Enable- Count=1/1 Maskable- 64bit+
Address: 0000000000000000 Data: 0000
Capabilities: [70] Express (v1) Root Complex Integrated Endpoint, MSI 00
DevCap: MaxPayload 128 bytes, PhantFunc 0
ExtTag- RBE-
DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop+
MaxPayload 128 bytes, MaxReadReq 128 bytes
DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
-
- Sophomore Member
- Posts: 137
- Joined: Sun May 04, 2008 2:26 pm
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
okay so it is even worse because it does work, but it reinitializes the setting:
I run the command and I loose 0.5 watt ! on battery.
But if I unplug and replug the card, the setting is back at and I must run again the command to gain battery life...
with the drivers RENESAS-USB3-Host-Driver-30230 from renesas, my usb key has quadrule write speeds
http://abload.de/image.php?img=ss2016-1 ... 2m6s1f.png
the other drives have the same speeds or a bit better
I run the command
Code: Select all
setpci -d 1912:0015 b0.b=43
But if I unplug and replug the card, the setting is back at
Code: Select all
00
with the drivers RENESAS-USB3-Host-Driver-30230 from renesas, my usb key has quadrule write speeds
http://abload.de/image.php?img=ss2016-1 ... 2m6s1f.png
the other drives have the same speeds or a bit better
-
- Sophomore Member
- Posts: 137
- Joined: Sun May 04, 2008 2:26 pm
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
I updated the firmware from 2020 to 2026, without much difference in speeds.
however, I notice that the device manager do not eject the card when I remove it from the taskbar.
In the device manager, the renesas host control get a yellow mark and stays there, even after the card is physically removed.
the problem is then that the next time the card is plugged in, the card is not recognized and I must plugged it out, then plugged it in to get it seen by windows.
anybody has this issue?
however, I notice that the device manager do not eject the card when I remove it from the taskbar.
In the device manager, the renesas host control get a yellow mark and stays there, even after the card is physically removed.
the problem is then that the next time the card is plugged in, the card is not recognized and I must plugged it out, then plugged it in to get it seen by windows.
anybody has this issue?
-
- Sophomore Member
- Posts: 137
- Joined: Sun May 04, 2008 2:26 pm
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
I put in the path the address of the pciutils, but I get the error, in the prompt
and in the event viewer
okay so the solution is to run as admin
then to delete any key with driver.sys
I do not know why there is a sudden corruption like this, but deleting the service works.
Code: Select all
D:\pgm\pciutils-3.4.0-win64>lspci
pcilib: i386-io-windows: IO library initialization failed. Try running from an elevated command prompt.
lspci: Cannot find any working access method.
Code: Select all
The DirectIO driver service failed to start due to the following error:
The system cannot find the file specified.
Code: Select all
sc delete driverIO
I do not know why there is a sudden corruption like this, but deleting the service works.
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
You mean
The only thing I can guess is that for some reason the service "thinks" that the file should not be where it was created and it "remembers" the wrong path until you delete it.
Code: Select all
sc delete DirectIO
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
-
- Junior Member
- Posts: 269
- Joined: Wed Feb 02, 2005 4:37 am
- Location: Hamburg / Germany
- Contact:
Re: ExpressCard USB3 adapters - read speed issue [ROOT-CAUSED]
Hallo
Best regards,
Andrey
nearly exactly 10 years later I have similar issue with his Express card by Renesas. My system is R61 with modified BIOS (no white list, SATA2 enabled). Thanks a lot for your explanation, but I have one question for your solution: should one apply it ONLY if laptop boots with card inserted, or in any case? I mean, I do not need this card permanently inserted into laptop. So, will it work if I just insert it when needed, after laptop has already booted?
Best regards,
Andrey
Last edited by BigCatAndy on Mon Jan 23, 2023 4:46 pm, edited 1 time in total.
- in use -
(1) TP R61i Frankepad - 4 GB / C2D T9500 / 180 GB SSD / UXGA display
(2) Lenovo 3000 N200 - 2 GB / C2D T7300 / 160 GB
(3) TP T450s
- in museum -
IBM 600x, IBM TP T43p, Lenovo TP Z61t, Lenovo TP X60 Tablet
(1) TP R61i Frankepad - 4 GB / C2D T9500 / 180 GB SSD / UXGA display
(2) Lenovo 3000 N200 - 2 GB / C2D T7300 / 160 GB
(3) TP T450s
- in museum -
IBM 600x, IBM TP T43p, Lenovo TP Z61t, Lenovo TP X60 Tablet
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
Re-reading my first post, it seems the workaround is not needed if the laptop has not been booted with the card inserted.BigCatAndy wrote: ↑Sun Jan 22, 2023 3:21 pmThanks a lot for your explanation, but I have one question for your solution: should one apply it ONLY if laptop boots with card inserted, or in any case? I mean, I do not need this card permanently inserted into laptop. So, will it work if I just insert it when needed, after laptop has already booted?
Thinkpad 25 (20K7), T490 (20N3), Yoga 14 (20FY), T430s (IPS FHD + Classic Keyboard), X220 4291-4BG
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
X61 7673-V2V, T60 2007-QPG, T42 2373-F7G, X32 (IPS Screen), A31p w/ Ultrabay Numpad
-
- Junior Member
- Posts: 269
- Joined: Wed Feb 02, 2005 4:37 am
- Location: Hamburg / Germany
- Contact:
Re: ExpressCard USB3 adapters - read speed issue [SOLVED]
Hello
Regards from Hamburg
thanks a lot, you confirm what I understood from your explanation.
Regards from Hamburg
- in use -
(1) TP R61i Frankepad - 4 GB / C2D T9500 / 180 GB SSD / UXGA display
(2) Lenovo 3000 N200 - 2 GB / C2D T7300 / 160 GB
(3) TP T450s
- in museum -
IBM 600x, IBM TP T43p, Lenovo TP Z61t, Lenovo TP X60 Tablet
(1) TP R61i Frankepad - 4 GB / C2D T9500 / 180 GB SSD / UXGA display
(2) Lenovo 3000 N200 - 2 GB / C2D T7300 / 160 GB
(3) TP T450s
- in museum -
IBM 600x, IBM TP T43p, Lenovo TP Z61t, Lenovo TP X60 Tablet
-
- Similar Topics
- Replies
- Views
- Last post
-
-
Caddy speed vs Main drive bay speed
by euless » Wed Nov 15, 2023 11:54 pm » in ThinkPad T430-T490 / T530-T590 Series - 1 Replies
- 1879 Views
-
Last post by axur-delmeria
Thu Nov 16, 2023 1:26 am
-
-
-
Internet Speed Test, who can you believe?
by RealBlackStuff » Tue Nov 14, 2023 3:51 am » in ** HOW TOs & FAQs ** - 20 Replies
- 7722 Views
-
Last post by ajkula66
Mon Feb 19, 2024 8:21 am
-
-
-
SOLVED On ThinkPad SR650 network don't work
by paolo_holzl » Mon Nov 20, 2023 11:43 am » in Windows 10/11/etc. - 0 Replies
- 2737 Views
-
Last post by paolo_holzl
Mon Nov 20, 2023 11:43 am
-
-
-
Is T420 Died? [SOLVED]
by N4b00 » Mon Feb 12, 2024 4:27 pm » in ThinkPad T400/T410/T420 and T500/T510/T520 Series - 4 Replies
- 819 Views
-
Last post by N4b00
Wed Feb 14, 2024 4:00 pm
-
Who is online
Users browsing this forum: No registered users and 15 guests