tag:infinitekind.tenderapp.com,2009-01-14:/discussions/online-banking/17896-schwab-downloads-all-3000-old-transactions-every-time-and-generates-a-new-6mb-out-directory-txn-file-every-timeInfinite Kind: Discussion 2021-05-04T22:50:24Ztag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-01-16T22:17:50Z2021-01-16T22:22:12ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>I am having this same problem, though not as severely as tbhimdi. (only 600 txns, downloaded infrequently.) My .moneydance file grows a few mb with every download.</p>
<p>The contents of my console after a download look very much like the console log attached to post #1. "Ignoring extraneous OFX tag:" in the same place.</p>
<p>I'm using version 2021 (3032).</p></div>kennyluciustag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-01-16T22:19:22Z2021-01-16T22:20:00ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>@tbhimdi - to skip a step, I'd advise you post version being used, operating system, etc. etc. - the more information you provide, the less questions you'll be asked.</p>
<p>just a user.</p>
<p>edit - kenny - same for you.</p></div>dtdtag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-01-16T22:23:00Z2021-01-16T22:23:02ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>@dtd Thank you, I should've done that! Post updated, let me know if I should add anything else.</p></div>tbhimditag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-01-17T00:49:32Z2021-01-17T00:49:32ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>The developer has just told me that he’s applied a slight tweak to the connection parameters to address this. It’s live now. ‘They shouldn't need to do anything, but clicking "refresh" in the Online->Setup Online Banking window should force the refresh of the connection parameters’. If you have this issue you refresh, have console window open, and try again.</p></div>Stuart Beesley (Mr Toolbox)tag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-01-17T17:30:56Z2021-02-02T23:42:36ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>UPDATE: The fix didn't work... User has done the refresh today. It didn’t work. The bottom status bar now shows “Downloading 3128 transactions”.. The tag appears 2164 times in the console log. The new 6MB txn file (created today) contains 3128 rows (and matches the status/download message). So MD is touching all records..</p>
<p>There is also a REPLACE tag</p>
<p>?</p></div>Stuart Beesley (Mr Toolbox)tag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-01-20T19:35:02Z2021-01-20T19:35:02ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>UPDATE: So for what I can gather (without the complete download file), all txns are NOT actually being sent by the bank (despite the status saying downloading 3000+ txns). It looks like MD is for some reason deciding to merge/touch/update all previously downloaded txns)...(this is the bulk of the console file). At this point, support will have to jump in and help you.. If it was my own dataset, in a test system I would try a variety of things, like resetting/deleting the bank profiles etc.. But this can only be done by you.</p>
<p>Separately, the developer (Sean) said that you can delete any txn files in your out directory as long as they are older than the last modified / updated time stamp on your trunk file.... Probably best to backup, move the txn files out, zip them up to keep for a while...</p>
<p>good luck</p>
<p>(not support, just a fellow user)</p></div>Stuart Beesley (Mr Toolbox)tag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-02-02T08:00:37Z2021-02-02T08:00:37ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>Hello!</p>
<p>Thanks to Stuart's digging I've finally realised the problem is that moneydance is caching the entire set of downloaded transactions rather than deleting them from the (outdated) internal data structure that it was storing them in. I will look into why they aren't automatically being deleted, but in the meantime I have a python script that should fix the problem.</p>
<p>Can you download the script from the following dropbox link:</p>
<p><a href="https://www.dropbox.com/s/ogu150tlfbzxd5w/delete_intermediate_downloaded_transaction_caches.py?dl=0">https://www.dropbox.com/s/ogu150tlfbzxd5w/delete_intermediate_downl...</a></p>
<p>and run it by doing the following:<br>
1) Select the Window -> Show MoneyBot Console menu 2) Click <code>Open Script</code> 3) select the downloaded file, and then click the "Run" button (not the Run Snippet button)</p>
<p>You can run the script repeatedly if you like, but it should resolve the problem from then on. In a couple of months your file sizes will start going down again and your file won't get any bigger in the meantime.</p>
<p>Thanks!<br>
Sean</p>
<p>--<br>
Sean Reilly<br>
Developer, The Infinite Kind<br>
<a href="https://infinitekind.com">https://infinitekind.com</a></p></div>Sean Reillytag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-02-02T08:50:37Z2021-02-02T08:50:37ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>Sean,</p>
<p>It appears that this script also fixes <a href="https://infinitekind.tenderapp.com/discussions/problems/57281-cleared-memo-fields-now-overwritten-when-downloading-account-info-from-bank">my long-standing issue</a>.</p>
<p>Thank you!<br>
ksb</p></div>Keith Beattietag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-02-02T21:56:01Z2021-02-02T23:44:32ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>I'm pleased to say that @tbhimdi has just confirmed that Toolbox (with a variant of this script) has fixed this issue for him.. It purged all 3115 cached Txns and then new downloads were successful. The script that Sean issued today (thanks Sean!) is essentially the same, but it cleanses the whole dataset - so great for an en-mass checkup/purge/cleanse too. I have now built both fixes into Toolbox extension (along with a lot more for OFX Bank management). I will release build 1022 over the next few days which will include both these fixes..</p></div>Stuart Beesley (Mr Toolbox)tag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-02-02T22:35:39Z2021-02-02T22:35:41ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>Sean, thanks for the script. It seems to have worked, but I did get a few errors on macOS Catalina:</p>
<p>"jff___.dylib cannot be opened because the developer cannot be verified."</p>
<p>The filename is randomly generated on every script run, twice for each run. The script finishes normally and exits. As I said, it seems to have cleared the issue regardless of the errors. I'm just reporting back in an effort to be helpful.</p>
<p>Screenshot attached. Again, thanks.</p></div>kennyluciustag:infinitekind.tenderapp.com,2009-01-14:Comment/489755792021-02-02T22:49:10Z2021-02-02T22:49:10ZSCHWAB Downloads all (3000 old) transactions every time, and generates a new 6MB out directory .txn file every time<div><p>Hi @kennylucius - FYI - this occurs on all Python scripts on Macs.. It's caused by Gatekeeper thinking that a dynamic file is potentially Malware.. Sean knows about this and is trying to find a fix... It's pretty difficult.. Anyway, you can IGNORE it. Click Trash and it should carry on... SCB</p></div>Stuart Beesley (Mr Toolbox)