Commit Graph

295 Commits (master)

Author SHA1 Message Date
Rafał Mikrut a623f2be00
Update all dependencies except trash which don't crosscompile on Windows (#395)
* Update all dependencies except trash which don't crosscompile on Windows
3 years ago
Rafał Mikrut b5f8d6b028
Update to gtk-rs 0.14 (#383)
* Update to Gtk-rs 0.14
3 years ago
Rafał Mikrut 237d879f03 Release 3.1.0 3 years ago
Rafał Mikrut cc0dcc2714
Fix excluded items on Windows (#324) 3 years ago
Rafał Mikrut 4fc8655272
Sort cache and allow to optimize later other code (#322) 3 years ago
Rafał Mikrut b08cedd5a6
Allow to set minimal file size to caching (#321) 3 years ago
Rafał Mikrut 775b6b4f10
Fix crashes with too small message queue (#316) 3 years ago
Rafał Mikrut 0fa6692d39
Fix error with saving results of name duplicates (#307) 3 years ago
Rafał Mikrut 50ad3f9873
Update to Rust 1.5.1 (#302) 3 years ago
Rafał Mikrut ce8161fd7e Release 3.0.0 3 years ago
Douman 67a07f1f98
Use xxhash-rust >=0.8.2 to avoid bug in stateful implementation (#283) 3 years ago
Rafał Mikrut 0bbe9fe4a3 Revert "Disable for now broken tga and gif files (#270)"
This reverts commit 87f5ca63
3 years ago
Rafał Mikrut 17f97bd958
Add option to turn off cache (#263) 3 years ago
Thomas Andreas Jung 1d904a858e
Dryrun for duplicates (#277)
```
    czkawka_cli dup --dryrun -d $(pwd)/folder -m1 -D aen
    Found 2 duplicated files in 1 groups with same content which took 2 B:
    Size - 2 B (2) - 2 files
    /home/thomas/Development/czkawka/folder/a
    /home/thomas/Development/czkawka/folder/b
    ----

    -------------------------------MESSAGES--------------------------------
    Delete /home/thomas/Development/czkawka/folder/a
    Delete /home/thomas/Development/czkawka/folder/b
    ---------------------------END OF MESSAGES-----------------------------
    ```
3 years ago
Thomas Andreas Jung ed7b197100
Use one implementation for all duplicate file removales (#278) 3 years ago
Rafał Mikrut 13add1cbed
Add hardlinking support for GUI (#276) 3 years ago
Rafał Mikrut 4c770b582b
Add option to not ignore hard links (#273) 3 years ago
Rafał Mikrut 7ea0126525 Release 2.4.0 3 years ago
Rafał Mikrut 87f5ca63b9
Disable for now broken tga and gif files (#270) 3 years ago
Thomas Andreas Jung e3457edab2
Use one implementation for all hash calculations (#268)
All implementations are the same they only differ by hasher and the file read
limit.
3 years ago
Thomas Andreas Jung 1e94587de8
Ignore duplicates if those are hard links (#234)
This is a proof of concept.

```
$ echo a > hardlinks/a
$ cp hardlinks/{a,b}
$ ln hardlinks/{a,c}
$ cargo run --bin czkawka_cli dup -m 1 --directories $(pwd)/hardlinks -f /dev/stderr > /dev/null
-------------------------------------------------Files with same hashes-------------------------------------------------
Found 1 duplicated files which in 1 groups which takes 2 B.

---- Size 2 B (2) - 2 files
/home/thomas/Development/czkawka/hardlinks/a
/home/thomas/Development/czkawka/hardlinks/b
```

Open:
- Windows support
- Probably this should be a cli option
3 years ago
Thomas Andreas Jung 03d41e173f
Keep original file if replacing duplicate with hardlink fails (#253)
If the user could not create a hard link (due to permissions or
different block devices) then czkawka lost the duplicate file.

```
$ mkdir hardlink
$ cd hardlink
$ echo a > a
$ cp a b
$ chown thetestuser:thetestuser a
$ ls -il .

25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
25169641 -rw-rw-r-- 1 thomas      thomas      2 Feb  7 11:18 b

$ cargo run --bin czkawka_cli dup --directories $(pwd) -m 1 -f
test101.result --delete-method HARD

[...]
-------------------------------WARNINGS--------------------------------
Failed to link /home/thomas/Development/czkawka/hardlink/b ->
/home/thomas/Development/czkawka/hardlink/a
---------------------------END OF WARNINGS-----------------------------

$ ls -il .
25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
```

Now czkawka keeps all files and the warning provides more information
why czkawka can't replace the duplicate with a hard link.

```
$ cargo run --bin czkawka_cli dup --directories $(pwd) -m 1 -f
test101.result --delete-method HARD

-------------------------------WARNINGS--------------------------------
Failed to link /home/thomas/Development/czkawka/hardlink/b ->
/home/thomas/Development/czkawka/hardlink/a (Operation not permitted (os
error 1))
---------------------------END OF WARNINGS-----------------------------
[...]

25169246 -rw-rw-r-- 1 thetestuser thetestuser 2 Feb  7 11:18 a
25169641 -rw-rw-r-- 1 thomas      thomas      2 Feb  7 11:18 b
```
3 years ago
Rafał Mikrut 10156ccfd3 Uncomment code about saving similar images result to file 3 years ago
Rafał Mikrut df44f9c342
Update list of checked images (#252) 3 years ago
Rafał Mikrut 9bb574235a
Add checking for broken music opt-in (#249) 3 years ago
Thomas Andreas Jung 3ffa55b008
Add delete method to replace duplicate files with hard links (#236)
This results in the same space saving but keeps the "deleted" files around.

$ mkdir hardlink
$ cd hardlink
$ echo a > a
$ cp a b
$ ln a c
$ touch -t 01010000 a
$ ls -il --time-style=full-iso .
25169323 -rw-rw-r-- 2 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 a
25169558 -rw-rw-r-- 1 thomas thomas 2 2021-01-31 18:11:08.298161098 +0100 b
25169323 -rw-rw-r-- 2 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 c

$ czkawka_cli dup --directories $(pwd)/hardlink -m 1 -f hardlink.result --delete-method HARD

$ ls --time-style=full-iso -li hardlink
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 a
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 b
25169323 -rw-rw-r-- 3 thomas thomas 2 2021-01-01 00:00:00.000000000 +0100 c
3 years ago
Rafał Mikrut 9f3da0e70f
Add support for CRC32 and XXH3 hash (#243) 3 years ago
Rafał Mikrut 7d8334bb0c
Add template for multiple hashes (#240) 3 years ago
Rafał Mikrut b8049efe62
Remove checking for ico in similar images (#227) 3 years ago
Rafał Mikrut 49ddc041ee
Add about dialog (#226) 3 years ago
Rafał Mikrut bb7bf12354 Release 2.3.2 3 years ago
Rafał Mikrut 69090755df Release 2.3.1 3 years ago
Rafał Mikrut 943f8f78f1 Release 2.3.0 3 years ago
Rafał Mikrut e1beaeed28
Decrease ram usage (#212) 3 years ago
Rafał Mikrut cc8d42e0ff
Add support for finding broken zip and audio files (#210) 3 years ago
Rafał Mikrut 7ec665ab7a
Add cache for duplicate (#205) 3 years ago
Rafał Mikrut 6e89bcb507
Add cache for broken files (#204) 3 years ago
Rafał Mikrut eeaaea20cc
Add broken files support (#202) 3 years ago
Rafał Mikrut 1a011644bf
Remove save workaround and fix crashes (#200) 3 years ago
Rafał Mikrut da4bdd19e2 Release 2.2.0 3 years ago
Rafał Mikrut 80bbc9ba85
Move image cache to cache from config dir (#197) 3 years ago
Rafał Mikrut 7992ba30de
Fix included/excluded files which contains commas (#195) 3 years ago
Rafał Mikrut 9975605f75
Add buffered write/read (#186) 3 years ago
Rafał Mikrut 3adbfdc5b6
Remove some debug variables (#185) 3 years ago
Rafał Mikrut 8d4a264c6d
Use master gtk plugin again (#179)
* Use master gtk plugin again
3 years ago
Rafał Mikrut 72d74dd8e2
Adds Mac GUI (#160)
* Adds Mac GUI

* Update Rust to 1.4.9
3 years ago
Rafał Mikrut 4eefe114dd Release 2.1.0 3 years ago
Rafał Mikrut 083db7aa51
Add manual adding of directories (#165) 3 years ago
Rafał Mikrut 10c32c90c0
Add support for delete button (#159) 3 years ago
Rafał Mikrut 33545dfa22
Fix using empty hash (#140) 3 years ago
Rafał Mikrut 3f333e7ceb
Add cache support for similar images (#139) 3 years ago
Rafał Mikrut 123bba381f Release 2.0.0 3 years ago
Rafał Mikrut 05c8153b1a Add more default excluded items 3 years ago
Rafał Mikrut 880787a67f
Show errors in image previewer when failed to generate it (#130) 3 years ago
Rafał Mikrut 5672431257
Add minimal similarity level (#129) 3 years ago
Rafał Mikrut 4e3a6f63fe
Add new windows dark theme (#125) 3 years ago
Rafał Mikrut 1d59199bb2
Add support for checking for invalid symlinks (#124) 3 years ago
Rafał Mikrut 40f981dcd3
Add custom selection/unselection (#117) 3 years ago
Rafał Mikrut f0f3073f94 Release version 1.5.1 3 years ago
Rafał Mikrut e6a6e5567b Release 1.5.0 4 years ago
Rafał Mikrut 7ac4a26229
Add progress bar (#106) 4 years ago
Rafał Mikrut 4dfb960e85 Small cosmetic changes to readme and similar images
Also added support for m4a music tags
4 years ago
Rafał Mikrut c62617df30 Release 1.4.0 4 years ago
Rafał Mikrut 29a0716be5
Add very small similarity level to finding similar images, add option to choose level from CLI, fix bug with duplicated entries in similar pictures (#104) 4 years ago
Rafał Mikrut 88d47e49cf
Add select for all modes (#102) 4 years ago
Rafał Mikrut 3e61544ec4
Add support for multithreading to zeroed files (#101) 4 years ago
Rafał Mikrut f359905ebc
Add support for multithreading in duplicate finder (#100) 4 years ago
Rafał Mikrut 31e35576ec
Add support for multithreading to finding same music (#99) 4 years ago
Rafał Mikrut 2f72dd9d19
Add multithread support to similar image finder (#98) 4 years ago
Rafał Mikrut 110d6015bc
Similar images improvements: (#97)
Headers without data
By default only checking for High Similarity(faster search)
4 years ago
Rafał Mikrut 5d4f4db8c1
Simplify some GUI code (#96) 4 years ago
Rafał Mikrut 1fb66b32f0 Release version 1.3.0 4 years ago
Rafał Mikrut ecebb3a1af
Implement finding duplicated music by tags/artist/year etc. (#95) 4 years ago
Rafał Mikrut 8ba780ded6
Add missing options in some modes (#90) 4 years ago
Rafał Mikrut 777ac50f07
Add support for checking for zeroed files (#88) 4 years ago
Rafał Mikrut 7112ff6b92
Add support for checking same file names (#84) 4 years ago
Rafał Mikrut d996c3c46b
Add pre hash check (#83) 4 years ago
Rafał Mikrut 4d90e3170e
Remove warnings about non existent directories in Windows (#79) 4 years ago
Rafał Mikrut 2326072222 Release version 1.2.1 4 years ago
Rafał Mikrut beb14f9f1d
Improve similar images GUI a little and add sorting to Similarity Enum (#73) 4 years ago
Syfaro a55fe3de9a
Make image similarity search significantly faster. (#72) 4 years ago
Rafał Mikrut d2c7398bdd Release version 1.2.0 4 years ago
Rafał Mikrut 1178e145ae
Add similar images support for GUI (#69) 4 years ago
Rafał Mikrut 3dd203f246
Add support for finding similar images to CLI (#66) 4 years ago
Dariusz Niedoba acfecd7ca3
Replace String with PathBuf for paths (#59) 4 years ago
Rafał Mikrut 67a775beff Release version 1.1 4 years ago
Rafał Mikrut d015b305f2
Add Windows support (#58) 4 years ago
Rafał Mikrut 8bbb12c7d4
Add ability to stop task from GUI (#55) 4 years ago
Caduser2020 085da0369e
Improve code quality. (#52)
* Remove verbose constructs in core.

* Use self and const fn where appropriate.

* Remove needless borrows.

* Fix name in function arguments.

* Merge 'master' into quality

* Decrease function complexity.

* Run fmt.

* Fix clippy.

* Fix duplicate extension files.

* Fix excluded items.

* Fix allowed extensions (Part 2).

* Fix temporary files.
4 years ago
Rafał Mikrut be30afdac6
Add support for searching in other thread (#51) 4 years ago
Rafał Mikrut 1a87a69116 Fixes some typos 4 years ago
Rafał Mikrut 71353823e7 Update version to 1.0.1 4 years ago
Rafał Mikrut 3b63798751 Don't crash when found file name which is not valid Unicode 4 years ago
Rafał Mikrut 8d263fdff2 Minimal file size in duplicate finder should be always greater than 0 4 years ago
Rafał Mikrut a0c99ab14b Don't crash when modified time of file is before unix epoch 4 years ago
Stefan Seering 1829d19b28 Switch to automatic updates for the program version. 4 years ago
Rafał Mikrut 8d824036b2 Release 1.0.0 version 4 years ago
Rafał Mikrut d3652c1e86 Updated README.md 4 years ago
Rafał Mikrut d7529cb64b Added support for Big, Temporary and empty file finder in GUI 4 years ago
Rafał Mikrut 7a1a9ea9f6 Change SystemTime to u64 4 years ago
Rafał Mikrut f550b42fc2 Add support for selecting and unselecting all records in duplicate finder 4 years ago
Rafał Mikrut 4bca6a133d Add Save system 4 years ago
Rafał Mikrut fe78ca4428 Add more info about packages 4 years ago
Rafał Mikrut d34100461e Bump version to 0.1.4 dev 4 years ago
Rafał Mikrut 18020cebde Added temporary ffile finder and also printed improved help 4 years ago
Rafał Mikrut 2cf5dcd513 Added support for empty file finder 4 years ago
Rafał Mikrut 338352f384 Added checking for duplicates by checking hash of first 1MB of file 4 years ago
Rafał Mikrut 4fb2a0cc92 Smaller code refactoring 4 years ago
Rafał Mikrut 85432f1c18 Fix some typos in words and remove empty space 4 years ago
Rafał Mikrut 8161a1c59b Big code refactoring 4 years ago
Rafał Mikrut 3cff32c031 Bump to 0.1.3 dev version 4 years ago
Rafał Mikrut 5f643d4356 Add big files finding to CLI 4 years ago
Rafał Mikrut d17f2d3ef1 Begin of working with finding biggest files 4 years ago
Rafał Mikrut 468c2d7a67 Unified look of enum elements 4 years ago
Rafał Mikrut 343c57f098 Clear a little remove code 4 years ago
Rafał Mikrut 05684a9051 Read more info from GUI fields 4 years ago
Rafał Mikrut 85b4190e8f Add support for version argument e.g.
`czkawka_cli --version`
4 years ago
Rafał Mikrut aba4e65fb8 Add empty folder support for GUI 4 years ago
Rafał Mikrut 85de5b412d Delete unused Cargo Lock files 4 years ago
Rafał Mikrut 063b5e0918 Bump version to 0.1.2 dev 4 years ago
Rafał Mikrut 2804af92e5 Remove unused code 4 years ago
Rafał Mikrut b1426d7f95 Added basic printing results in tree_view 4 years ago
Rafał Mikrut 5326024a9b Add support for checking how much data was read by tool[REAL FIX] 4 years ago
Rafał Mikrut 5d10e273a2 Fixed release build printing debug prints 4 years ago
Rafał Mikrut 3d297b3657 Format better file save message 4 years ago
Rafał Mikrut 2b9c0d61df Add saving to empty folders finder, remove exclude directories from it and put warnings to another function 4 years ago
Rafał Mikrut cf127d5c36 Add errors and warnings class 4 years ago
Rafał Mikrut 6b26d4b6fe Use as_str() where possible 4 years ago
Rafał Mikrut 249adfc821 Merge function which finds duplication by size with removing entries which contains only 1 entry 4 years ago
Rafał Mikrut 5caff93a51 Show how much files are in groups 4 years ago
Rafał Mikrut 99b85c73c2 Fixed invalid groups number when saving to file 4 years ago
Rafał Mikrut 4757b28486 Simplify code with duplication and checking 4 years ago
Rafał Mikrut 0f06ed636a Improved searching and printing duplicated entries,
Saving to file
4 years ago
Rafał Mikrut cff5ac93c4 Added support for non recursive search 4 years ago
Rafał Mikrut 4b68330393 Added support for excluded items with wildcard * 4 years ago
Rafał Mikrut a08b4549ba Removed almost all occurrences of println from core 4 years ago
Rafał Mikrut bccc69bd99 Beginning of removing printing text from core. 4 years ago
Rafał Mikrut b19612cfdf Added support for different buttons events for different notebook tabs 4 years ago
Rafał Mikrut feee8c6a83 Add basic search 4 years ago
Rafał Mikrut 843ce17107 Update version to 0.1.1 4 years ago
Rafał Mikrut b71051cda6 Added changelog
Fixed some crashes
4 years ago
Rafał Mikrut bbb13d79ce Fixes some crashes when permissions are denied 4 years ago
Rafał Mikrut 1ccaa91129 Better explanation, starting working with GUI 4 years ago
Rafał Mikrut 7eeff49426 Add some comments 4 years ago
Rafał Mikrut 9d4de08ece Use different modules for library and GUI and CLI apps 4 years ago