bug: Double Indexing of Web-Connector App Indexable Documents

[Vivek-Lahole]

Describe the bug

Ideal Behavior

• The web-connector should schedule job only once and index docs

Bug Behavior

• Currently the web-connector scheduled job run twice to scrap data and index docs

URL of the page where the issue is observed.

http://localhost:3001/dashboard/marketplace/web-connector

Steps To Reproduce

1. Navigate to marketplace
2. Install Web-Connector App
3. Submit a link to index scrapped data from provide base_url
4. Observe the backend console to see double indexing of docs

Expected Behavior

Ideal Behavior

• The web-connector should schedule job only once and index docs

Bug Behavior

• Currently the web-connector scheduled job run twice to scrap data and index docs

Screenshots/Videos

No response

Operating System

Windows

Additional context

No response