Comments (10)
@rajaseg It looks like the configurations you've used to run your connector has enable_document_permission
field set to Yes, but the enterprise search instance does not have a License that allows document level permissions.
Can you confirm from your end if that's the case and try running the connector by making enable_document_permission to No. Let us know if it works by doing so.
from enterprise-search-sharepoint-server-connector.
@rajaseg It looks like the configurations you've used to run your connector has
enable_document_permission
field set to Yes, but the enterprise search instance does not have a License that allows document level permissions.Can you confirm from your end if that's the case and try running the connector by making enable_document_permission to No. Let us know if it works by doing so.
@praveen-elastic Thanks for the reply. I confirm that we disabled the 'enable_document_permission' option in the connector configuration while syncing the content
from enterprise-search-sharepoint-server-connector.
Do you mind sharing your configuration file after removing the credentials ? We'll try to replicate this issue.
from enterprise-search-sharepoint-server-connector.
Do you mind sharing your configuration file after removing the credentials ? We'll try to replicate this issue.
@praveen-elastic Please find the config below.
#Configurations for the SharePoint 2016 Connector
#SharePoint 2016 configuration settings
#The domain name of the sharepoint server for NTLM authenticaion
sharepoint.domain: "example.com"
#The username used to login to Sharepoint server
sharepoint.username: "FarmAdmin"
#The password used to login to Sharepoint server
sharepoint.password: "removed"
#The address of the sharepoint farm. Example: http://sharepoint-host:14293/
sharepoint.host_url: "https://sharepoint.example.com/""
#Specifies the site collections whose contents the user wants to fetch and index.
sharepoint.site_collections:
- marketing
#Workplace Search configuration settings
#Api key for Workplace search authentication
workplace_search.api_key: "jmtgvadouf527obnqjoxrb1a"
#Source identifier for the custom source created on the workplace search server
workplace_search.source_id: "628545984586a6e50e36d0e4"
#Workplace search server address Example: http://es-host:3002/
enterprise_search.host_url: "http://ip:3002/"
#Connector specific configuration settings
#Denotes whether document permission will be enabled or not
#enable_document_permission: Yes
#Specifies the objects to be fetched and indexed in the WorkPlace search along with fields that needs to be included/excluded. The list of the objects supported are collection, site, list, and listItem. By default all the objects are fetched
objects:
sites:
include_fields:
exclude_fields:
lists:
include_fields:
exclude_fields:
list_items:
include_fields:
exclude_fields:
drive_items:
include_fields:
exclude_fields:
#The time after which all the objects that are modified or created are fetched from Sharepoint. By default, all the objects present in the SharePoint till the end_time are fetched
start_time :
#The timestamp before which all the updated objects need to be fetched i.e. the connector won’t fetch any object updated/created after the end_time. By default, all the objects updated/added till the current time are fetched
end_time :
#The level of the logs the user wants to use in the log files. The possible values include: DEBUG, INFO, WARN, ERROR. By default, the level is info
log_level: INFO
#The number of retries to perform in case of server error. The connector will use exponential backoff for retry mechanism
retry_count: 3
#Number of threads to be used in multithreading for the sharepoint sync.
sharepoint_sync_thread_count: 5
#Number of threads to be used in multithreading for the enterprise search sync.
enterprise_search_sync_thread_count: 5
#the path of csv file containing mapping of sharepoint user ID to Workplace user ID
#sharepoint_workplace_user_mapping: "/home/user/users.csv"
from enterprise-search-sharepoint-server-connector.
Hey, @rajaseg, Following is one issue in the config you've shared above:
Since the line enable_document_permission: Yes
has been commented out, the connector will take default value (True) for this field from schema.py file.
Hence the connector will try to add permissions in the Enterprise Search instance but since your enterprise search is having basic license which is why you are getting this error: ['Invalid field name: _allow_permissions']
Please try to run your connector will following changes: uncomment the field enable_document_permission and set it to No
Attaching the config with the said changes:
#Configurations for the SharePoint 2016 Connector
#SharePoint 2016 configuration settings
#The domain name of the sharepoint server for NTLM authenticaion
sharepoint.domain: "example.com"
#The username used to login to Sharepoint server
sharepoint.username: "FarmAdmin"
#The password used to login to Sharepoint server
sharepoint.password: "removed"
#The address of the sharepoint farm. Example: http://sharepoint-host:14293/
sharepoint.host_url: "https://sharepoint.example.com/"
#Specifies the site collections whose contents the user wants to fetch and index.
sharepoint.site_collections:
- marketing
#Workplace Search configuration settings
#Api key for Workplace search authentication
workplace_search.api_key: "jmtgvadouf282obnqjoxrb1a"
#Source identifier for the custom source created on the workplace search server
workplace_search.source_id: "628545276786a6e50e36d0e4"
#Workplace search server address Example: http://es-host:3002/
enterprise_search.host_url: "http://ip:3002/"
#Connector specific configuration settings
#Denotes whether document permission will be enabled or not
enable_document_permission: No
#Specifies the objects to be fetched and indexed in the WorkPlace search along with fields that needs to be included/excluded. The list of the objects supported are collection, site, list, and listItem. By default all the objects are fetched
objects:
sites:
include_fields:
exclude_fields:
lists:
include_fields:
exclude_fields:
list_items:
include_fields:
exclude_fields:
drive_items:
include_fields:
exclude_fields:
#The time after which all the objects that are modified or created are fetched from Sharepoint. By default, all the objects present in the SharePoint till the end_time are fetched
start_time :
#The timestamp before which all the updated objects need to be fetched i.e. the connector won’t fetch any object updated/created after the end_time. By default, all the objects updated/added till the current time are fetched
end_time :
#The level of the logs the user wants to use in the log files. The possible values include: DEBUG, INFO, WARN, ERROR. By default, the level is info
log_level: INFO
#The number of retries to perform in case of server error. The connector will use exponential backoff for retry mechanism
retry_count: 3
#Number of threads to be used in multithreading for the sharepoint sync.
sharepoint_sync_thread_count: 5
#Number of threads to be used in multithreading for the enterprise search sync.
enterprise_search_sync_thread_count: 5
#the path of csv file containing mapping of sharepoint user ID to Workplace user ID
#sharepoint_workplace_user_mapping: "/home/user/users.csv"
from enterprise-search-sharepoint-server-connector.
Hey, @rajaseg, Following is one issue in the config you've shared above: Since the line
enable_document_permission: Yes
has been commented out, the connector will take default value (True) for this field from schema.py file. Hence the connector will try to add permissions in the Enterprise Search instance but since your enterprise search is having basic license which is why you are getting this error:['Invalid field name: _allow_permissions']
Please try to run your connector will following changes: uncomment the field enable_document_permission and set it to
No
Attaching the config with the said changes:#Configurations for the SharePoint 2016 Connector #SharePoint 2016 configuration settings #The domain name of the sharepoint server for NTLM authenticaion sharepoint.domain: "example.com" #The username used to login to Sharepoint server sharepoint.username: "FarmAdmin" #The password used to login to Sharepoint server sharepoint.password: "removed" #The address of the sharepoint farm. Example: http://sharepoint-host:14293/ sharepoint.host_url: "https://sharepoint.example.com/" #Specifies the site collections whose contents the user wants to fetch and index. sharepoint.site_collections: - marketing #Workplace Search configuration settings #Api key for Workplace search authentication workplace_search.api_key: "jmtgvadouf282obnqjoxrb1a" #Source identifier for the custom source created on the workplace search server workplace_search.source_id: "628545276786a6e50e36d0e4" #Workplace search server address Example: http://es-host:3002/ enterprise_search.host_url: "http://ip:3002/" #Connector specific configuration settings #Denotes whether document permission will be enabled or not enable_document_permission: No #Specifies the objects to be fetched and indexed in the WorkPlace search along with fields that needs to be included/excluded. The list of the objects supported are collection, site, list, and listItem. By default all the objects are fetched objects: sites: include_fields: exclude_fields: lists: include_fields: exclude_fields: list_items: include_fields: exclude_fields: drive_items: include_fields: exclude_fields: #The time after which all the objects that are modified or created are fetched from Sharepoint. By default, all the objects present in the SharePoint till the end_time are fetched start_time : #The timestamp before which all the updated objects need to be fetched i.e. the connector won’t fetch any object updated/created after the end_time. By default, all the objects updated/added till the current time are fetched end_time : #The level of the logs the user wants to use in the log files. The possible values include: DEBUG, INFO, WARN, ERROR. By default, the level is info log_level: INFO #The number of retries to perform in case of server error. The connector will use exponential backoff for retry mechanism retry_count: 3 #Number of threads to be used in multithreading for the sharepoint sync. sharepoint_sync_thread_count: 5 #Number of threads to be used in multithreading for the enterprise search sync. enterprise_search_sync_thread_count: 5 #the path of csv file containing mapping of sharepoint user ID to Workplace user ID #sharepoint_workplace_user_mapping: "/home/user/users.csv"
@praveen-elastic Thanks for the input. I will try that option and update the outcome.
from enterprise-search-sharepoint-server-connector.
@praveen-elastic I was able to sync the content from the SharePoint server to Workplace search. But the metadata is missing and the link is not enabled.
from enterprise-search-sharepoint-server-connector.
Hey @rajaseg, can you please provide more input regarding the metadata which is missing ? Probably a screenshot of the same would be helpful.
from enterprise-search-sharepoint-server-connector.
Hey @rajaseg, can you please provide more input regarding the metadata which is missing ? Probably a screenshot of the same would be helpful.
Hey, @praveen-elastic Please find the screenshot below. Link not clickable and missing metadata of the file
It should show metadata like the below image. The link is clickable here.
from enterprise-search-sharepoint-server-connector.
Hey, @rajaseg, I've created separate issue for this. You can track that here #55
from enterprise-search-sharepoint-server-connector.
Related Issues (20)
- Sharepoint Server - icons and connectors aren't consistent HOT 7
- Sharepoint Server - Full Sync not working HOT 4
- Sharepoint Server - Check that documents are indexed - Config file isn't found by default HOT 1
- Sharepoint Server - Permissions Sync isn't working HOT 5
- "winget install make" dependancy instructions not working as expected HOT 9
- Should SharePoint in Microsoft 365 be listed under SharePoint Server compatibility? HOT 2
- make test_connectivity Sharepoint test fails HOT 6
- Connector service vs connector webservice? HOT 3
- What determines whether user gets Connector Owners permission? HOT 6
- Test instance is running but _api endpoint not working HOT 2
- Metadata is missing and url is not clickable in Workplace Search HOT 11
- Add sharepoint server connector to updated connector framework HOT 1
- allow custom certificates
- Missing Sub-sites and incorrect count of documents in logger
- [Bug] Running connector against 2 different configurations with different content source id produces unexpected results HOT 6
- [Bug] Links in Enterprise Search search application lead to 404s HOT 5
- [Bug] Permission sync does not properly handle invalid responses from Enterprise Search
- It would be amazing if it were possible to authenticate using kerberos HOT 4
- Index SharePoint root site collection
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from enterprise-search-sharepoint-server-connector.