Failing transaction gets resubmitted forever in the Head

[ghost]

Context & versions

• We have a connected 2 hydra-nodes running Hydraw
• We managed to have a Head open and started drawing but suddenly it stopped when I clicked too quickly

Steps to reproduce

1. Run 2 hydra nodes + hydraw
2. Make sure the nodes are connected
3. Start a head
4. Load the Hydraw UI
5. Click frantically
6. Check the hydra-node's logs

Actual behavior

The hydra node keeps trying to apply the transaction with messages like this one:

hydra-node_1    | {"timestamp":"2022-09-12T10:10:09.191655156Z","threadId":92,"namespace":"HydraNode-1","message":{"node":{"by":{"vkey":"bbe62eb1184ea5f51fc746f800726784152510fe3626f6f08e6a5d30b7c3ae4b"},"effect":{"delay":0.1,"event":{"message":{"party":{"vkey":"bbe62eb1184ea5f51fc746f800726784152510fe3626f6f08e6a5d30b7c3ae4b"},"tag":"ReqTx","transaction":{"auxiliaryData":"d90103a100a10e85081018ff0000","body":{"auxiliaryDataHash":"ab77677459c63a307a1eb3cf8ef362c9f3401b46d1ee4773eb456a0681cabdc0","fees":0,"inputs":["00e794ee635f7d33275aa1bd62ef98929e82f8c6ebd59918ae88bf0bba303538#1"],"outputs":[{"address":"addr_test1vzh72m4cyl252py9cx77e99zwrnctt8fhu6c8aq4m5354rqepg0rr","datum":null,"datumhash":null,"inlineDatum":null,"referenceScript":null,"value":{"lovelace":9832475}}]},"id":"91b4c8af292039459cc4ba837887ea11b875813a91740577ba90ddd9ac396a25","isValid":true,"witnesses":{"keys":["8200825820ea295cfdd2914067994eeae8a7a32e9862180596bb88db85d9ee8f3b241f32d6584039cf6c45f6bf47f452e274b2231e9bac63a3a709127af22c047afd3c57a9d65f5b72f53a8826ddd47d1a91a45ecf86a3889500762bdc85c7bd94b512487eb106"]}}},"tag":"NetworkEvent"},"reason":{"tag":"WaitOnNotApplicableTx","validationError":{"reason":"ApplyTxError [UtxowFailure (UtxoFailure (FromAlonzoUtxoFail (ValueNotConservedUTxO (Value 0 (fromList [])) (Value 9832475 (fromList []))))),UtxowFailure (UtxoFailure (FromAlonzoUtxoFail (BadInputsUTxO (fromList [TxIn (TxId {_unTxId = SafeHash \"00e794ee635f7d33275aa1bd62ef98929e82f8c6ebd59918ae88bf0bba303538\"}) (TxIx 1)]))))]"}},"tag":"Delay"},"tag":"ProcessedEffect"},"tag":"Node"}}
hydra-node_1    | {"timestamp":"2022-09-12T10:10:09.191930245Z","threadId":92,"namespace":"HydraNode-1","message":{"node":{"by":{"vkey":"bbe62eb1184ea5f51fc746f800726784152510fe3626f6f08e6a5d30b7c3ae4b"},"event":{"message":{"party":{"vkey":"bbe62eb1184ea5f51fc746f800726784152510fe3626f6f08e6a5d30b7c3ae4b"},"tag":"ReqTx","transaction":{"auxiliaryData":"d90103a100a10e85081018ff0000","body":{"auxiliaryDataHash":"ab77677459c63a307a1eb3cf8ef362c9f3401b46d1ee4773eb456a0681cabdc0","fees":0,"inputs":["00e794ee635f7d33275aa1bd62ef98929e82f8c6ebd59918ae88bf0bba303538#1"],"outputs":[{"address":"addr_test1vzh72m4cyl252py9cx77e99zwrnctt8fhu6c8aq4m5354rqepg0rr","datum":null,"datumhash":null,"inlineDatum":null,"referenceScript":null,"value":{"lovelace":9832475}}]},"id":"91b4c8af292039459cc4ba837887ea11b875813a91740577ba90ddd9ac396a25","isValid":true,"witnesses":{"keys":["8200825820ea295cfdd2914067994eeae8a7a32e9862180596bb88db85d9ee8f3b241f32d6584039cf6c45f6bf47f452e274b2231e9bac63a3a709127af22c047afd3c57a9d65f5b72f53a8826ddd47d1a91a45ecf86a3889500762bdc85c7bd94b512487eb106"]}}},"tag":"NetworkEvent"},"tag":"ProcessedEvent"},"tag":"Node"}}

Expected behavior

The hydra node should stop trying to apply a failing transaction after a while. In other words, a submitted tx should have a Time To Live