Failing to shring dataset

samaklis's Avatar

samaklis

02 Apr, 2023 11:26 AM

I am trying to shrink my dataset with Toolbox, but when I do so, I get an error that the processed.dct file is a directory (I guess the tool is looking for a file instead)

Does anyone know how to fix this issue?

ERROR LOG OUTPUT
--------------------------
Found 6059 files in folder: /.moneydancesync/bb1febf6-84de-4fec-b149-590a08901adf/v3
logging txn; file: tiksync/out/20230402111030_398.txn-tmp
giving the sync thread a kick
toolbox.py(Extension):2023/04/02-07:10:30: .
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@@@@@ UNEXPECTED ERROR CAUGHT!
Traceback (most recent call last):
  File "bootstrapped_toolbox.py", line 25765, in advanced_options_shrink_dataset
FileNotFoundException: java.io.FileNotFoundException: /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/processed.dct (Is a directory)
  File "bootstrapped_toolbox.py", line 28741, in actionPerformed
  File "bootstrapped_toolbox.py", line 25773, in advanced_options_shrink_dataset
  File "bootstrapped_toolbox.py", line 745, in dump_sys_error_to_md_console_and_errorlog
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
toolbox.py(Extension):2023/04/02-07:10:30: Sorry - cannot proceed as error processing tiksync/processed.dct (review console for details)

DATASET output
-------------------
Dataset size: 232.4MB
- settings file size: 47.4KB
- key file size: 0.1KB
- tiksync folder size: 231.7MB (with 10462 files)
  (note trunk file size: 37.5MB)
- attachments size: 0.0MB (in 0 attachments)
- archive size: 0.0MB (in 0 files)
---------------------------------------------
Valid files size: 231.8MB (in 10464 files)

  1. 1 Posted by Stuart Beesley ... on 02 Apr, 2023 12:45 PM

    Stuart Beesley (Mr Toolbox)'s Avatar

    That's odd.. I'm hoping that you are on MD2023.1(5006) running an old version of toolbox (build 1057) with wifi off so that it didn't self-block toolbox?

    Please send whole help/console?

    Please do this.
    Extensions Menu/Manage extensions/Installed. Find toolbox. UNINSTALL it. Then from the available list, select and install toolbox.

    Restart MD, try again.

    Let me know?

  2. 2 Posted by samaklis on 02 Apr, 2023 03:31 PM

    samaklis's Avatar

    Thanks for your quick reply.
    I have done as you suggested but I am still getting the same error.

    I am running: 2023.1 (5006)

    Not sure if it helps but in line 10554 of the attached console log I can see the error below:

    unable to invoke atomic rename method: java.lang.reflect.InvocationTargetException
    I/O error when copyng file /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/_processed.dct to: /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/processed.dct
    java.io.FileNotFoundException: /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/processed.dct (Is a directory)
    at java.base/java.io.FileOutputStream.open0(Native Method)
    at java.base/java.io.FileOutputStream.open(Unknown Source)
    at java.base/java.io.FileOutputStream.<init>(Unknown Source)
    at java.base/java.io.FileOutputStream.<init>(Unknown Source)
    at com.infinitekind.util.IOUtils.copyFile(IOUtils.kt:201)
    at com.infinitekind.util.IOUtils.renameMostlyAtomicallyWithoutNIO(IOUtils.kt:477)
    at com.infinitekind.util.IOUtils.writeAtomically(IOUtils.kt:519)
    at com.moneydance.apps.md.controller.AccountBookWrapper$LocalStorageWrapper.writeToFileAtomically(AccountBookWrapper.java:841)
    at com.infinitekind.tiksync.Syncer.saveNewTrunkFile(Syncer.kt:345)
    at com.infinitekind.tiksync.Syncer.doInitialLoad(Syncer.kt:146)
    at com.infinitekind.moneydance.model.AccountBook.doInitialLoad(AccountBook.java:133)
    at com.moneydance.apps.md.controller.AccountBookWrapper.loadDataModel(AccountBookWrapper.java:418)
    at com.moneydance.apps.md.controller.Main.setCurrentBook(Main.java:1330)
    at com.moneydance.apps.md.controller.Main.startApplication(Main.java:861)
    at com.moneydance.apps.md.controller.Main.main(Main.java:175)
    at Moneydance.main(Moneydance.java:7)

  3. 3 Posted by Stuart Beesley ... on 02 Apr, 2023 03:55 PM

    Stuart Beesley (Mr Toolbox)'s Avatar

    You have some weird stuff going on there... The good news (for me) is that it's nothing to do with toolbox..! 😉

    For some reason, MD wants to reapply all your (already consumed) mdtxn files... E.g. 1000s of:
    reading txn file 40904ba3-cd54-4eac-b015-95e5b62f8736.mdtxn

    and then the crash:

    unable to invoke atomic rename method: java.lang.reflect.InvocationTargetException
    I/O error when copyng file /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/_processed.dct to: /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/processed.dct
    java.io.FileNotFoundException: /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/processed.dct (Is a directory)
        at java.base/java.io.FileOutputStream.open0(Native Method)
        at java.base/java.io.FileOutputStream.open(Unknown Source)
        at java.base/java.io.FileOutputStream.<init>(Unknown Source)
        at java.base/java.io.FileOutputStream.<init>(Unknown Source)
        at com.infinitekind.util.IOUtils.copyFile(IOUtils.kt:201)
        at com.infinitekind.util.IOUtils.renameMostlyAtomicallyWithoutNIO(IOUtils.kt:477)
        at com.infinitekind.util.IOUtils.writeAtomically(IOUtils.kt:519)
        at com.moneydance.apps.md.controller.AccountBookWrapper$LocalStorageWrapper.writeToFileAtomically(AccountBookWrapper.java:841)
        at com.infinitekind.tiksync.Syncer.saveNewTrunkFile(Syncer.kt:345)
        at com.infinitekind.tiksync.Syncer.doInitialLoad(Syncer.kt:146)
        at com.infinitekind.moneydance.model.AccountBook.doInitialLoad(AccountBook.java:133)
        at com.moneydance.apps.md.controller.AccountBookWrapper.loadDataModel(AccountBookWrapper.java:418)
        at com.moneydance.apps.md.controller.Main.setCurrentBook(Main.java:1330)
        at com.moneydance.apps.md.controller.Main.startApplication(Main.java:861)
        at com.moneydance.apps.md.controller.Main.main(Main.java:175)
        at Moneydance.main(Moneydance.java:7)
    

    There is something wrong with your processed.dct file:
    /Users/samaklco/Library/Containers/com.infinitekind.MoneydanceOSX/Data/Documents/Dino.moneydance/safe/tiksync/processed.dct

    This is why the txn files are being reapplied..

    So, do some digging.. Is it there? Is it locked? Permission problems? Do you get this issue on other datasets? Is antivirus locking it? What happens if you use MD2022.6(4097) - same issue in console?

    etc....

    ??

  4. 4 Posted by samaklis on 02 Apr, 2023 06:29 PM

    samaklis's Avatar

    Can Moneydance support chime in if it is ok to stop sync, then delete in my data dir everything under .../<moneydancefile>/safe/tiksync and then re-enable sync to fix this issue?

  5. 5 Posted by Stuart Beesley ... on 02 Apr, 2023 06:57 PM

    Stuart Beesley (Mr Toolbox)'s Avatar

    No. Do NOT do that! I did not say that at all.

    You/we need to investigate the issue as I said.

    I’m the meantime can you run toolbox. Analyse dataset and objects and post that output here.

  6. Support Staff 6 Posted by Sean Reilly on 02 Apr, 2023 08:25 PM

    Sean Reilly's Avatar

    Hello,

    This sounds like a problem that needs a screen sharing session. Would you be able to book the soonest one that is convenient for you via the link below, and then please not launch moneydance or remove any backups or dropbox files until that time? I'm sure we can get this resolved, but a processed.dct file that is actually a folder is something that should never happen.

    https://calendly.com/tikhelp/30min

    Thanks!
    Sean

    --
    Sean Reilly
    Developer, The Infinite Kind
    https://infinitekind.com

  7. 7 Posted by Stuart Beesley ... on 03 Apr, 2023 08:42 AM

    Stuart Beesley (Mr Toolbox)'s Avatar

    FYI - I just tested this myself.. And yes, if you change processed.dct into a directory/folder (which you should NEVER do) then you get this message, and result...

    So something has 'done' this to your file...

    I'm sure Sean will fix this later for you... Good luck...

  8. System closed this discussion on 03 Jul, 2023 08:50 AM.

Comments are currently closed for this discussion. You can start a new one.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac