Thanks Christian,

add tangyongqian in the loop.

On 7 December 2017 at 17:40, Christian König christian.koenig@amd.com wrote:

Hi Xinliang,

please provide the output of lspci and the content of /proc/iomem

will privide these info asap.

Thanks, Christian.

Am 07.12.2017 um 10:35 schrieb Xinliang Liu:

...

Hi,

We are trying ATI HD 7470 card on arm64 platform D05 with kernel 4.1.40. But it failed with kernel log: radeon 0005:01:00: ring 0 stalled for more than 10000msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 10500msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 11000msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 11500msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) ...

Any clue? Any required setting on BIOS IO mem bar video ram? It seems that our PCIE controller doesn't support cacheable feature for IO mem bar video ram.

Best, Xinliang

Hi Christian,

On 2017/12/7 17:57, Xinliang Liu wrote:

cc z.liuxinliang@hisilicon.com

On 7 December 2017 at 17:54, Xinliang Liu xinliang.liu@linaro.org wrote:

...

Thanks Christian,

add tangyongqian in the loop.

On 7 December 2017 at 17:40, Christian König christian.koenig@amd.com wrote:

...

Hi Xinliang,

please provide the output of lspci and the content of /proc/iomem

----- #lspci -vt -+-[0007:40]---00.0-[41]----00.0  Device 19e5:1711  +-[0006:08]---00.0-[09]----00.0  Device 19e5:1710  +-[0005:00]---00.0-[01]--+-00.0  Advanced Micro Devices, Inc. [AMD/ATI] Caicos XT [Radeon HD 7470/8470 / R5 235/310 OEM]  |                        -00.1  Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6400 Series]  +-[0004:48]---00.0-[49]--  +-[0002:e8]---00.0-[e9]--  -[0000:00]-

#lspci -vvv 0002:e8:00.0 PCI bridge: Device 19e5:1610 (rev 01) (prog-if 00 [Normal decode])     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Bus: primary=e8, secondary=e9, subordinate=e9, sec-latency=0     I/O behind bridge: 0000f000-00000fff     Memory behind bridge: fff00000-000fffff     Prefetchable memory behind bridge: fff00000-000fffff     Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-     BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-         PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [50] MSI: Enable- Count=1/32 Maskable+ 64bit+         Address: 0000000000000000  Data: 0000         Masking: 00000000  Pending: 00000000     Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00         DevCap:    MaxPayload 512 bytes, PhantFunc 0             ExtTag- RBE+         DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 512 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-         LnkCap:    Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s unlimited, L1 <64us             ClockPM- Surprise- LLActRep+ BwNot+         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-         RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-         RootCap: CRSVisible-         RootSta: PME ReqID 0000, PMEStatus- PMEPending-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd+         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-         LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Capabilities: [158 v1] #19     Capabilities: [178 v1] Transaction Processing Hints         No steering table available     Kernel driver in use: pcieport

0004:48:00.0 PCI bridge: Device 19e5:1610 (rev 01) (prog-if 00 [Normal decode])     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Bus: primary=48, secondary=49, subordinate=49, sec-latency=0     I/O behind bridge: 0000f000-00000fff     Memory behind bridge: fff00000-000fffff     Prefetchable memory behind bridge: fff00000-000fffff     Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-     BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-         PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [50] MSI: Enable- Count=1/32 Maskable+ 64bit+         Address: 0000000000000000  Data: 0000         Masking: 00000000  Pending: 00000000     Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00         DevCap:    MaxPayload 512 bytes, PhantFunc 0             ExtTag- RBE+         DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 512 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-         LnkCap:    Port #0, Speed 8GT/s, Width x8, ASPM L1, Exit Latency L0s unlimited, L1 <64us             ClockPM- Surprise- LLActRep+ BwNot+         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-         RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-         RootCap: CRSVisible-         RootSta: PME ReqID 0000, PMEStatus- PMEPending-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd+         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-         LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Capabilities: [158 v1] #19     Capabilities: [178 v1] Transaction Processing Hints         No steering table available     Kernel driver in use: pcieport

0005:00:00.0 PCI bridge: Device 19e5:1610 (rev 01) (prog-if 00 [Normal decode])     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Bus: primary=00, secondary=01, subordinate=01, sec-latency=0     I/O behind bridge: 00000000-00000fff     Memory behind bridge: 40000000-400fffff     Prefetchable memory behind bridge: 0000000500000000-000000050fffffff     Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-     BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-         PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [50] MSI: Enable- Count=1/32 Maskable+ 64bit+         Address: 0000000000000000  Data: 0000         Masking: 00000000  Pending: 00000000     Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00         DevCap:    MaxPayload 512 bytes, PhantFunc 0             ExtTag- RBE+         DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-         LnkCap:    Port #0, Speed 8GT/s, Width x8, ASPM not supported, Exit Latency L0s unlimited, L1 <64us             ClockPM- Surprise- LLActRep+ BwNot-         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-         RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-         RootCap: CRSVisible-         RootSta: PME ReqID 0000, PMEStatus- PMEPending-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd+         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-         LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [b0] MSI-X: Enable- Count=32 Masked-         Vector table: BAR=0 offset=00000000         PBA: BAR=0 offset=00000800     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Capabilities: [158 v1] #19     Capabilities: [1b8 v1] Transaction Processing Hints         No steering table available     Kernel driver in use: pcieport

0005:01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Caicos XT [Radeon HD 7470/8470 / R5 235/310 OEM] (prog-if 00 [VGA controller])     Subsystem: Bitland(ShenZhen) Information Technology Co., Ltd. Radeon HD 8470     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Interrupt: pin A routed to IRQ 1367     Region 0: Memory at 500000000 (64-bit, prefetchable) [size=256M]     Region 2: Memory at 440000000 (64-bit, non-prefetchable) [size=128K]     Region 4: I/O ports at 20000 [size=256]     Expansion ROM at 440020000 [disabled] [size=128K]     Capabilities: [50] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [58] Express (v2) Legacy Endpoint, MSI 00         DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited             ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-         DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-         LnkCap:    Port #8, Speed 5GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us             ClockPM- Surprise- LLActRep- BwNot-         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-         DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR-, OBFF Not Supported         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled         LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+         Address: 00000008c6010040  Data: 0000     Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>     Capabilities: [150 v1] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Kernel driver in use: radeon

0005:01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Caicos HDMI Audio [Radeon HD 6400 Series]     Subsystem: Bitland(ShenZhen) Information Technology Co., Ltd. Device aa98     Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Interrupt: pin B routed to IRQ 1368     Region 0: Memory at 440040000 (64-bit, non-prefetchable) [size=16K]     Capabilities: [50] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [58] Express (v2) Legacy Endpoint, MSI 00         DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited             ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-         DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-         LnkCap:    Port #8, Speed 5GT/s, Width x16, ASPM L0s L1, Exit Latency L0s <64ns, L1 <1us             ClockPM- Surprise- LLActRep- BwNot-         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-         DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR-, OBFF Not Supported         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+         Address: 00000008c6010040  Data: 0000     Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>     Capabilities: [150 v1] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Kernel driver in use: snd_hda_intel

0006:08:00.0 PCI bridge: Device 19e5:1610 (rev 01) (prog-if 00 [Normal decode])     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Bus: primary=08, secondary=09, subordinate=09, sec-latency=0     I/O behind bridge: 0000f000-00000fff     Memory behind bridge: 42000000-47ffffff     Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff     Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-     BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-         PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [50] MSI: Enable- Count=1/32 Maskable+ 64bit+         Address: 0000000000000000  Data: 0000         Masking: 00000000  Pending: 00000000     Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00         DevCap:    MaxPayload 512 bytes, PhantFunc 0             ExtTag- RBE+         DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-         LnkCap:    Port #0, Speed 8GT/s, Width x8, ASPM not supported, Exit Latency L0s unlimited, L1 <64us             ClockPM- Surprise- LLActRep+ BwNot+         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt+         RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-         RootCap: CRSVisible-         RootSta: PME ReqID 0000, PMEStatus- PMEPending-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd+         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-         LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Capabilities: [158 v1] #19     Capabilities: [178 v1] Transaction Processing Hints         No steering table available     Kernel driver in use: pcieport

0006:09:00.0 Signal processing controller: Device 19e5:1710 (rev 01)     Subsystem: Device 19e5:0000     Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Interrupt: pin A routed to IRQ 1365     Region 0: Memory at 744000000 (32-bit, prefetchable) [disabled] [size=64M]     Region 1: Memory at 742000000 (32-bit, non-prefetchable) [disabled] [size=1M]     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+         Address: 0000000000000000  Data: 0000     Capabilities: [70] Express (v2) Endpoint, MSI 00         DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited             ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-         DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-         LnkCap:    Port #0, Speed 2.5GT/s, Width x1, ASPM not supported, Exit Latency L0s <512ns, L1 <64us             ClockPM- Surprise- LLActRep- BwNot-         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled         LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-

0007:40:00.0 PCI bridge: Device 19e5:1610 (rev 01) (prog-if 00 [Normal decode])     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Bus: primary=40, secondary=41, subordinate=41, sec-latency=0     I/O behind bridge: 0000f000-00000fff     Memory behind bridge: 84800000-849fffff     Prefetchable memory behind bridge: 86000000-87ffffff     Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-     BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-         PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [70] Express (v2) Root Port (Slot-), MSI 00         DevCap:    MaxPayload 512 bytes, PhantFunc 0             ExtTag- RBE+         DevCtl:    Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-         LnkCap:    Port #0, Speed 8GT/s, Width x4, ASPM not supported, Exit Latency L0s unlimited, L1 <64us             ClockPM- Surprise- LLActRep+ BwNot+         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt+         RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-         RootCap: CRSVisible-         RootSta: PME ReqID 0000, PMEStatus- PMEPending-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR+, OBFF Not Supported ARIFwd+         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-         LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Capabilities: [158 v1] #19     Capabilities: [178 v1] Transaction Processing Hints         No steering table available     Kernel driver in use: pcieport

0007:41:00.0 VGA compatible controller: Device 19e5:1711 (rev 01) (prog-if 00 [VGA controller])     Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-     Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-     Latency: 0     Interrupt: pin A routed to IRQ 1366     Region 0: Memory at 786000000 (32-bit, prefetchable) [size=32M]     Region 1: Memory at 784800000 (32-bit, non-prefetchable) [size=2M]     Capabilities: [40] Power Management version 3         Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)         Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-     Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+         Address: 0000000000000000  Data: 0000     Capabilities: [70] Express (v2) Legacy Endpoint, MSI 00         DevCap:    MaxPayload 256 bytes, PhantFunc 0, Latency L0s unlimited, L1 unlimited             ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-         DevCtl:    Report errors: Correctable- Non-Fatal- Fatal- Unsupported-             RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-             MaxPayload 256 bytes, MaxReadReq 512 bytes         DevSta:    CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-         LnkCap:    Port #0, Speed 2.5GT/s, Width x1, ASPM not supported, Exit Latency L0s <512ns, L1 <64us             ClockPM- Surprise- LLActRep- BwNot-         LnkCtl:    ASPM Disabled; RCB 64 bytes Disabled- CommClk-             ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-         LnkSta:    Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-         DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported         DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled         LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-              Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-              Compliance De-emphasis: -6dB         LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-              EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-     Capabilities: [100 v2] Advanced Error Reporting         UESta:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UEMsk:    DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-         UESvrt:    DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-         CESta:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         CEMsk:    RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+         AERCap:    First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-     Kernel driver in use: hisifb

#cat /proc/iomem 00000000-3fbfffff : System RAM   00080000-01c87113 : Kernel code   01e47000-0207dfff : Kernel data 40340000-4034ffff : /p0_edacmc@40340000 40350000-4035ffff : /p0_edacmc@40350000 602b0000-602b0fff : /soc/uart@602b0000   602b0000-602b0fff : /soc/uart@602b0000 60340000-6034ffff : /p0_edacmc@60340000 60350000-6035ffff : /p0_edacmc@60350000 603c0000-603c0fff : /soc/p0_mdio@603c0000 a0040000-a005ffff : /p0_edac_smmu_pcie_a a00a0000-a00affff : rc_dbi a00e0000-a00effff : pcs a01b0000-a01bffff : /lpc@a01b0000 a2000000-a200ffff : /sas@a2000000 a3000000-a300ffff : /sas@a3000000 a7020000-a702ffff : /p0_na_usb_ehci a7030000-a703ffff : /p0_na_usb_ohci be800000-beffffff : ecam-cfg c0040000-c005ffff : /p0_edac_smmu_dsa_a c3000000-c300ffff : /sas@c3000000 c4000000-c40fffff : /soc@000000000/infiniband@c4000000 d0040000-d005ffff : /p0_edac_smmu_alg_a d0100000-d010ffff : /i2c@d0100000 400000000-4007fffff : ecam-cfg 440040000-440043fff : ICH HD audio 700040000-70005ffff : /p0_edac_smmu_pcie_b 700090000-70009ffff : rc_dbi 7000a0000-7000affff : rc_dbi 7000b0000-7000bffff : rc_dbi 7000c0000-7000cffff : pcs 7000d0000-7000dffff : pcs 7000e0000-7000effff : pcs 7000f0000-7000fffff : pcs 700200000-70020ffff : rc_dbi 702000000-70200ffff : /sas@702000000 703000000-70300ffff : /sas@703000000 740800000-740ffffff : ecam-cfg 784000000-7847fffff : ecam-cfg 7c4800000-7c4ffffff : ecam-cfg 8c0040000-8c005ffff : /p0_edac_smmu_dsa_b 8c3000000-8c300ffff : /sas@8c3000000 8d0040000-8d005ffff : /p0_edac_smmu_alg_b 1040000000-13ffffffff : System RAM 1400000000-1bffffffff : System RAM   1bc0000000-1bffffffff : Crash kernel

-----

...

will privide these info asap.

...

Thanks, Christian.

Am 07.12.2017 um 10:35 schrieb Xinliang Liu:

...

Hi,

We are trying ATI HD 7470 card on arm64 platform D05 with kernel 4.1.40. But it failed with kernel log: radeon 0005:01:00: ring 0 stalled for more than 10000msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 10500msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 11000msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 11500msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) ...

Any clue? Any required setting on BIOS IO mem bar video ram? It seems that our PCIE controller doesn't support cacheable feature for IO mem bar video ram.

Best, Xinliang

.

On 7 December 2017 at 19:11, Michel Dänzer michel@daenzer.net wrote:

On 2017-12-07 10:35 AM, Xinliang Liu wrote:

...

Hi,

We are trying ATI HD 7470 card on arm64 platform D05 with kernel 4.1.40. But it failed with kernel log: radeon 0005:01:00: ring 0 stalled for more than 10000msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 10500msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 11000msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) radeon 0005:01:00: ring 0 stalled for more than 11500msec radeon 0005:01:00: GPU lockup (current fence id 0x0000000000000001 last fence id 0x0000000000000002 on ring0) ...

Any clue?

Any chance you can try a newer kernel? Somebody else (also @huawei.com incidentally) reported just this week on the mesa-dev mailing list that the amdgpu driver in the Ubuntu 4.13 kernel is working on an arm64 platform.

If a newer kernel still doesn't work on your platform, please provide the full dmesg output.

Hope we have change to try newer kernel. After tracking the mainline we had found that this commit[1] fixed this issue. The root cause is that on old kernel ttm can't succeed to set page writecombine property which make cpu/gpu in fatal status and stub.

Anyway, we should use newer kernel and keep on testing.

[1] f135b97 drm/ttm: recognize ARM64 arch in ioprot handler https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h...

BTW, in the other thread it was reported that Mesa has bugs which can be worked around by compiling it with -fsigned-char.

Thanks for letting us know this. Had looked into the mesa bug.

Thanks, Xinliang

-- Earthling Michel Dänzer | http://www.amd.com Libre software enthusiast | Mesa and X developer