gh-118150: difflib: expose autojunk flag from SequenceMatcher to public methods and functions

[faithlesstomas]

Until now difflib methods and functions took SequenceMatcher class kwarg autojunk by default which is set up to be True in this class.. This PR aims to expose this flag to the public methods and functions of this module, in order that user can choose behavior of this option in SequenceMatcher.

Issue: #118150
Related PR: #153892

• Issue: Difflib creates unreasonably large diffs #118150

[python-cla-bot]

All commit authors signed the Contributor License Agreement.

[bedevere-app]

Most changes to Python require a NEWS entry. Add one using the blurb_it web app or the blurb command-line tool.

If this change has little impact on Python users, wait for a maintainer to apply the skip news label instead.

[faithlesstomas]

Quick check if this works for the original issue test:

 #!/usr/bin/python3                                                                                                                                                          
                                                                                                                                                                              
  import difflib                                                                                                                                                              
                                                                                                                                                                              
  def get_lines(filename):                                                                                                                                                    
      with open(filename, 'r', encoding='utf8') as fd:                                                                                                                        
          return fd.readlines()                                                                                                                                               
                                                                                                                                                                              
  for autojunk in (True, False):                                                                                                                                              
                                                                                                                                                                              
      old_new = list(difflib.unified_diff(                                                                                                                                    
          get_lines('small.external.old.json'),                                                                                                                               
          get_lines('small.external.new.json'),                                                                                                                               
          autojunk=autojunk                                                                                                                                                   
      ))                                                                                                                                                                      
      new_old = list(difflib.unified_diff(                                                                                                                                    
          get_lines('small.external.new.json'),                                                                                                                               
          get_lines('small.external.old.json'),                                                                                                                               
          autojunk=autojunk                                                                                                                                                   
      ))                                                                                                                                                                      
                                                                                                                                                                              
      print('Autojunk flag:', autojunk)                                                                                                                                       
      print('diff external.old external.new.json | wc -l')                                                                                                                    
      print(len(old_new))                                                                                                                                                     
      print('diff external.new external.old.json | wc -l')                                                                                                                    
      print(len(new_old))                                                                                                                                                     

Autojunk flag: True
diff external.old external.new.json | wc -l
90
diff -u external.new external.old.json | wc -l
25
Autojunk flag: False
diff external.old external.new.json | wc -l
25
diff -u external.new external.old.json | wc -l
25

#118150 (comment)

[Lenormju]

I think the Documentation (Doc/library/difflib.rst) should get updated too to include this new parameter.

[hugovk]

Please could you add tests to Lib/test/test_difflib.py?

[read-the-docs-community]

Documentation build overview

📚 cpython-previews | 🛠️ Build #34393160 | 📁 Comparing d8dff8a against main (dd5a285)

  🔍 Preview build  

108 files changed · + 1 added · ± 107 modified

+ Added

• library/time-complexity.html

± Modified

• glossary.html
• index.html
• c-api/arg.html
• c-api/capsule.html
• c-api/frame.html
• c-api/import.html
• c-api/veryhigh.html
• extending/extending.html
• faq/design.html
• faq/programming.html
• and 97 more...

[encukou]

The change looks good; let's make the docs great :)

[encukou]

Thank you!