Python scrapy not working - "ImportError: no module name settings"

Question

scrappy lib in /usr/lib/python2.7/site-packages/scrapy
my project directory:

.../projects/scrapy                                       
.../projects/parser_module                                     
....../projects/parser_module/parser  
....../projects/parser_module/parser           
........../projects/parser_module/parser/spiders/.....     
........../projects/parser_module/parser/<files etc>   
....../projects/parser_module/scrapy.cfg

The .../projects/parser_module/command is given in the directory scrapy crawl parserand get the result:

Traceback (most recent call last):                                                                   

 File "/usr/bin/scrapy", line 4, in <module>                                                         
   execute()                                                                                         
  File "/usr/lib/python2.7/site-packages/scrapy/cmdline.py", line 109, in execute  
  settings = get_project_settings() 
  File "/usr/lib/python2.7/site-packages/scrapy/utils/project.py", line 60, in get_project_settings  
    settings.setmodule(settings_module_path, priority='project')          
  File "/usr/lib/python2.7/site-packages/scrapy/settings/__init__.py", line 108, in setmodule        
    module = import_module(module)                                                                   
  File "/usr/lib64/python2.7/importlib/__init__.py", line 37, in import_module                       
    __import__(name)                                                                                 
ImportError: No module named settings  

Could you tell me how to solve the problem?

Answer 1

to avoid such a problem, create a project folder with scrapy startproject parser_module

Now, to fix your problem, you either have a fresh start, or create a dummy project with scrapy startprojectto copy the setting.py parameter. Then maybe the next error, you will find another missing file in this folder.

This is a typical cleanup project structure.

.
├── scrapy.cfg
└── project_name
    ├── __init__.py
    ├── items.py
    ├── settings.py
    └── spiders
        └── __init__.py
            spider.py

Answer 2

"ImportError: *.settings", scrapy.cfg