This issue tracker is closed. Please visit UPPAAL issue tracker at Github instead.

Bug 596 - Incorrect result for batch run in verifier
Summary: Incorrect result for batch run in verifier
Status: RESOLVED FIXED
Alias: None
Product: UPPAAL
Classification: Unclassified
Component: Engine (show other bugs)
Version: 4.1.19
Hardware: PC Windows 7
: P5 critical
Assignee: Marius Mikučionis
URL:
Depends on:
Blocks:
 
Reported: 2015-05-29 11:45 CEST by Allan Munck
Modified: 2019-03-23 12:53 CET (History)
1 user (show)

See Also:
Architecture:


Attachments
A simple model that illustrates the problem (1.91 KB, text/xml)
2015-05-29 11:45 CEST, Allan Munck
Details

Note You need to log in before you can comment on or make changes to this bug.
Description Allan Munck 2015-05-29 11:45:55 CEST
Created attachment 279 [details]
A simple model that illustrates the problem

The verification results are incorrect, when the queries are run as a batch (all selected) in the verifier tab in UPPAAL.

For the attached example, all queries (Q1 - Q4) pass when run as a batch.
However, this is incorrect: We know that Q4 should fail!
When we run the queries individually, we get the correct results.

I have previously seen a similar problem (which is probably caused by the same problem): Changing one query may affect the results of other queries (and care has been taken to ensure that the queries are side-effect-free).

I have marked the problem as critical because a formal verifier should never present wrong results.

PS: How do we get a newer version than 4.19?

Best regards,
Allan Munck
Comment 1 Allan Munck 2015-05-29 14:48:39 CEST
Also, the external verifier "verifyta" produces different results than shown in the verifier tab in UPPAAL.
Comment 2 Marius Mikučionis 2015-05-29 16:05:53 CEST
Dear Alan Munck,

Thanks for the report.

I am trying to reproduce it and I observe the strange behavior (not satisfied in individual checks and erroneously satisfied in batch) with the first query:

A[] APP.ShowingList imply APP.listSize() == MaxRftListLength

The other 3 queries are satisfied (correctly).

There is no newer public release, but there's a beta snapshot:
http://people.cs.aau.dk/~marius/beta/uppaal-4.1.20-beta7.zip
(it seems that this particular issue is fixed over there)

Marius
Comment 3 Marius Mikučionis 2019-03-23 12:53:36 CET
Fixed in the 4.1.20 release