Anthony Koletti returned to the witness box on Wednesday at the NSW Coroners Court inquest into his wife's disappearance and suspected death.
Mr Koletti told counsel assisting Jason Downing SC that on the morning of her disappearance on November 12, 2020, he assumed Ms Caddick had gone out to do some exercise.
"I didn't think anything of it ... she's just gone for a walk which she does every day not a problem," he told police in an interview.
In evidence Mr Koletti agreed that his wife had no habits, her exercise regime was irregular and she mostly jogged on the treadmill by that stage.
Mr Downing continued questioning Mr Koletti on Wednesday about this inconsistency asking if he was now trying to justify his answers.
"One of the accounts must not be true," Mr Downing said.
"I'm guessing so, yes," Mr Koletti said.
"Why are you guessing?" Mr Downing said.
"Because your questions are confusing, the way you talk is not the way my mind works," Mr Koletti said.
"Everyone has got a different mind you've got to understand that.
"I don't think you do.
"I've been through a lot in case you haven't noticed."
Questions then turned to where her phone was found, by whom, and when. Mr Koletti had told police a different version to his evidence in court.
"You're just going around in circles like you were before," Mr Koletti said.
"I can't answer these questions over and over again."
His lawyer Judy Swan then interjected saying her client was finding the process distressing, but wanted "it over".
He's trying to answer to the best of his knowledge but he's obviously struggling with the nuances," Ms Swan said.
"I don't know if it's a mental disconnect or general disconnect. He's distressed and has been for a while."
Deputy State Coroner Elizabeth Ryan said counsel's questions were legitimate and it was her duty to determine if Ms Caddick is alive, and if not, the manner and cause of her death.
She asked whether Mr Koletti was mentally unable to continue, otherwise there was an expectation he would continue to provide answers to questions.
Mr Downing said he understood Mr Koletti's desire to complete the process but his evidence would not assist the inquest if he was too distressed.
The court adjourned to assess Mr Koletti's fitness and desire to continue.
He previously said on Tuesday that he had always been truthful but admitted there may have been moments when his "wires were crossed" due to his concern and worry.
He maintains he had no inkling his wife was defrauding family and friends of millions of dollars, nor did he ask her why federal police or the Australian Securities and Investments Commission was suddenly searching their Sydney eastern suburbs home.
It was the last verified sighting of Ms Caddick before she vanished without a trace.
The inquest continues.