Problem Overview
On a SIMATIC S7-400H high-availability system wired to multiple ET 200HF distributed I/O stations, the redundant interface pair (two IM 153-2HF heads on a single active backplane) drops the entire rack every time a service engineer pulls a single digital or analog I/O card from the active bus. The fault is not a power supply problem, not a Profibus ring break, and not a connector pull — it occurs only when a module is physically unseated from the active backplane, even though the S7-400H redundancy is supposed to mask such hot-swap events.
Symptom signature:
- Active IM 153-2HF registers a short fault, switches to the standby IM, and immediately switches back.
- All 12 slots in the rack report I/O lost for the duration of the disturbance.
- Connected plant trips because loss-of-I/O exceeds the configured PCS 7 OB122 / OB70 process time.
- Power-cycling the affected card, or removing/reinserting the front connector, does not reproduce the failure — only physical removal from the active bus does.
Reference System Configuration
The reference plant runs the topology shown in the table below. Every ET 200HF rack is configured as a redundant pair on a single active backplane.
| Component | Catalog / Order Number | Role |
|---|---|---|
| AS controller | CPU 417-4H (6ES7 417-4XT05-0AB0), firmware V4.5.x | Redundant S7-400H central unit |
| Distributed I/O head | IM 153-2HF (6ES7 153-2BA70-0XB0) | Redundant Profibus DP slave, active backplane |
| Active bus module | BM PS/IM (6ES7 195-7HA00-0XA0) and BM IM/DO (6ES7 195-7HD00-0XA0) | Active backplane for hot swap |
| I/O card (example, in fault path) | 6ES7 331-7TF01-0AB0 — physically FW V3.1 | SM 331, AI 8 × TC, 16-bit |
| Profibus physical layer | OLM / P11, OLM / P12, OLM / P22, OLM / G12, OLM / G12-1300, OLM / G12-EEC — V4.0 | Optical ring with redundancy |
| Engineering | STEP 7 V5.5 + PCS 7 V8.0 SPx | HW Config, NetPro, CFC/SFC |
The OLM ring is correctly closed and the IM 153-2HF pairs are configured for redundant mode (Y-link not used; standard DP-V1 redundancy with both heads on the same Profibus segment). Both OLM channels report healthy redundancy at the time of the disturbance, so the ring itself is not the cause.
Observed Diagnostic Events
Pulling one card from the active bus produces the following ordered sequence in the H-CPU diagnostic buffer. Timestamps are from the original incident; event IDs and parameters are reproducible.
| # | Event ID (hex) | Meaning | Key Parameters | Direction |
|---|---|---|---|---|
| 1 | 16#3942 | Module problem or maintenance necessary — digital/analog SM diagnostic interrupt | Module type = Digital SM, slot 4, internal module power supply failed, OB82 requested | Incoming |
| 2 | 16#73A3 | DP — loss of redundancy at DP slave | DP slave = C054, redundant partner missing, return code 0215 | Incoming |
| 3 | 16#39C4 | Distributed I/Os — station failure | Station 1956 / C054, slot 3FFD, return code 3FF5 / 0115 | Incoming |
The ordering is significant: the slot-level diagnostic interrupt precedes the redundancy loss by ~34 s, and the redundancy loss precedes the station failure by ~21 ms. The station failure (16#39C4) is the one the operator sees, but it is a downstream consequence of the redundancy loss (16#73A3) and the slot-level supply fault (16#3942). Always read the buffer bottom-up when triaging Profibus redundant stations.
Root Cause: Module Firmware Version Mismatch
The actual failure mechanism is a mismatch between the module firmware version selected in HW Config and the firmware version on the physical module. The reference plant used an imported station (XML import from a previous site) in which the AI 8 × TC module 6ES7 331-7TF01-0AB0 was specified using an older catalog entry. On the bench, the physical cards carry the newest firmware V3.1, which Siemens exposes in the catalog under a different article identifier — typically the “V3.x / V3.0” consolidated entry — not the older V1.x or V2.x entry used in the import.
When the module is normally present and answering Profibus DP-V1 reads, the version mismatch is invisible: the slot returns a value and the cyclic data is interpreted correctly enough to keep the plant running. The moment the module is removed, the IM 153-2HF checks the slot against its configured slot signature. Because the configured signature describes a different firmware revision than the one the IM previously negotiated, the slot is treated as unrecognised, and the IM propagates a station-level failure to the H-CPU rather than a per-slot diagnostic. The H-CPU briefly loses the whole rack, the redundant IM 153-2HF takes over, the standby IM also fails the same check, and the rack drops off Profibus until the next power cycle of the active head.
Why one rack ran clean and the rest tripped: the clean rack was rebuilt by hand in HW Config against the correct PCS 7 V8 catalog and the correct IM 153-2 subfolder. Its modules were specified with the V3.x / V3.0 consolidated entry that matches the actual physical firmware. Every imported rack that retained the older catalog entry exhibited the trip on the next hot-swap event.
Step-by-Step Resolution
- Capture the H-CPU diagnostic buffer immediately after a hot-swap-induced trip. Filter for event IDs 16#3942, 16#73A3, and 16#39C4. Note the DP slave address (parameter block 0xC054 in the reference) and the slot word (0x3FFD).
- Read the actual firmware of every module in the affected rack. In SIMATIC Manager, right-click the DP slave → Object Properties → Module Information, or use the IM 153-2HF online diagnostics. Record the order number and the FW version for each slot.
- Open HW Config for the affected ET 200HF station and compare the configured Order Number / Version of each SM/AI/AO/DI/DO module against the actual hardware reading. Pay particular attention to high-pin-count modules (6ES7 331-7TF01-0AB0, 6ES7 332-5HF00-0AB0, 6ES7 321-1BL00-0AA0) where Siemens ships multiple firmware revisions under the same MLFB.
- Delete the affected DP slave from the Profibus subnet in HW Config. Do not just edit the slot — delete the station and recreate it from scratch so that the catalog entry used is guaranteed to come from the current PCS 7 V8 catalog set.
- Re-insert the ET 200HF from the catalog: Profibus DP → ET 200M → IM 153-2HF. Use the catalog entry that matches the firmware revision in the rack. For modules whose firmware is > V3.0, use the consolidated V3.x / V3.0 entry where the catalog offers it.
- Re-assign the I/O addresses to match the original address map. PB address, slot count, and module order must remain identical to the previous configuration to avoid touching the CFC/SFC application.
- Compile, download HW Config to the standby CPU first, then to the master. Allow a switchover to confirm both sides accept the configuration without OB82 / OB83 / OB85 events in the buffer.
- Repeat for every affected ET 200HF. Do not assume that because one station works, all stations are correct. The reference plant had to rebuild several racks before the entire fleet was clean.
Verification Procedure
After reconfiguration, perform the following checks before declaring the rack ready for hot-swap operation in a live plant:
| Check | Method | Pass Criterion |
|---|---|---|
| No diagnostic events in idle state | Read H-CPU diagnostic buffer after 30 min of steady operation | Zero 16#39C4 / 16#73A3 / 16#3942 events |
| Hot-swap of a non-essential DO | Pull the card with the rack in Run and the partner IM 153-2HF healthy | OB83 (Insert/Remove) fires once for the slot, partner IM retains cyclic data, no 16#39C4 |
| Hot-swap of a representative AI | Pull a thermocouple SM 331 (6ES7 331-7TF01-0AB0) on a non-critical loop | Slot reports module not available, partner IM keeps the rack, no 16#73A3, no plant trip |
| Switchover during hot-swap | Force a CPU master/standby switchover while a card is being pulled | Rack recovers within one Profibus cycle, no station failure logged |
| Ring break tolerance | Open one OLM channel | OLM switches to single-channel mode, IM pair still exchanges, no 16#39C4 |
If any verification step reproduces 16#39C4 or 16#73A3, return to Step 3 — a module version is still wrong.
Preventive Measures
- Never deploy an imported station blindly. XML import carries the catalog state of the source site. Reopen every imported DP slave in HW Config, confirm the catalog entry against the current PCS 7 catalog, and recompile.
- Maintain a rack-as-built sheet that lists the order number and FW version of every module in every ET 200HF. Cross-check the sheet against HW Config at every modification.
- Prefer consolidated catalog entries (e.g. V3.x / V3.0) for modules that are known to ship in multiple firmware revisions. The consolidated entry survives a future module swap-out with a different FW within the same range.
- Run a hot-swap drill in commissioning for every redundant rack. The reference fault never appears in normal operation; it is only visible when an engineer pulls a card. A scripted OB83/OB82 expectation is the only reliable way to catch a configuration defect before the plant trips.
- Read buffers bottom-up. Always triage Profibus redundant events in reverse chronological order. The station failure (16#39C4) is almost never the root cause — it is the consequence of a slot-level event (16#3942) and a redundancy-level event (16#73A3).
Related Event-ID Reference
| Event ID | Category | Common Trigger | Action |
|---|---|---|---|
| 16#3942 | Module diagnostic interrupt (OB82) | Internal module power supply, wire break, overrange, FW mismatch on removal | Check module diagnostics online; verify catalog version |
| 16#73A3 | DP redundancy loss | Standby head cannot synchronise, partner DP failure, slot signature reject | Check both IM 153-2HF heads; verify slot configuration |
| 16#39C4 | Station failure | DP slave drops off bus | Look for upstream 16#73A3 / 16#3942 events on the same slave address |
| 16#39C3 | Station return | DP slave reappears | Confirm cyclic data is good for one full DP cycle before resetting process interlocks |
Documentation References
- SIMATIC S7-1500 / ET 200MP Manual Collection — Replacing an I/O Module (maintenance procedure for hot-swap of I/O modules, applicable principles to ET 200M / ET 200HF on active backplane).
- SIMATIC NET PROFIBUS OLM Operating Instructions, chapter 5.10 Configuration — required reading for OLM ring setup with redundant DP masters (OLM / P11, P12, P22, G12, G12-EEC, G11-1300, G12-1300 V4.0).
- SIMATIC S7-400H Fault-Tolerant Systems, System Manual — chapter on redundant I/O configuration and the role of OB70 / OB72 / OB82 / OB83 in masking hot-swap events.
- STEP 7 V5.5 Help: Diagnostic Events of the CPU — canonical list of 16#39xx, 16#73xx event IDs and their parameter-block decoding.
FAQ
Why does pulling one card drop the whole rack when both IM 153-2HF heads are present and the Profibus ring is closed?
The rack does not actually lose the partner IM. It loses Profibus DP communication with the whole station because the IM reports a station-level failure (event 16#39C4) instead of a per-slot diagnostic. This happens when the slot signature configured in HW Config does not match the signature the IM 153-2HF previously negotiated with the module. The slot is treated as unrecognised on removal, the IM 153-2HF drops the DP slave, and the H-CPU loses every slot in the rack until the next station return (16#39C3). Check the firmware version of every module against the HW Config catalog entry — a mismatched V3.x module specified as a V1.x or V2.x entry is the typical cause.
How do I find the firmware version of a 6ES7 331-7TF01-0AB0 already installed in the rack?
In SIMATIC Manager, connect online to the H-CPU, expand the DP slave, and read the module information. The firmware version is shown alongside the order number. Compare it with the catalog entry in HW Config: under SIMATIC 300 → SM 300 → AI 300, the module appears with one or more version suffixes. For firmware V3.0 and V3.1, select the V3.x / V3.0 consolidated entry if the catalog provides it, otherwise select the exact V3.x entry.
Can I keep the XML import of the station and just edit the module versions?
It is possible but not recommended. The reference plant found that stations rebuilt by hand from the current PCS 7 V8 catalog (with the correct IM 153-2 subfolder) were reliable, while stations produced by editing the imported XML still occasionally produced 16#73A3 events on hot-swap. Delete the DP slave, re-insert it from the catalog, re-assign the original Profibus address and I/O addresses, recompile, and download. This is the only configuration that was field-proven to clear the fault on the affected site.
Is the OLM ring causing the fault?
No. The OLM ring is correctly configured and the redundancy mode is verified. The 16#73A3 event originates inside the IM 153-2HF pair, not in the OLM channel. If the OLM ring were the cause, the event log would show OLM channel diagnostic events (16#39xx with OLM-specific return codes) and both IM 153-2HF heads would still be reachable. Confirm by opening one OLM channel during a hot-swap test — the rack should still tolerate it once the catalog versions are correct.
What OBs must be loaded to mask a hot-swap event on ET 200HF?
Load OB82 (diagnostic interrupt) and OB83 (insert/remove) on both H-CPUs. For redundant I/O on a Y-link, also load OB70 (I/O redundancy loss) and OB72 (CPU redundancy loss). Without OB82, every module diagnostic — including the slot signature reject that precedes the rack drop — escalates to a CPU stop, which is what trips the plant. With OB82 loaded and the catalog versions correct, a single hot-swap produces one OB83 plus an OB82 entry, and the partner IM 153-2HF keeps the rack online.